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From Our Briefease 

















Accounting Update 


This feature, originally entitled “Ac- 
counting News,” will be a regular 
feature of “From Our Briefcase” in 
future issues. 


GAO Establishes 
Conferences on Single 
Audit 


GAO held two conferences on the 
single audit approach at the GAO 
Building in June and August 1982. 
These conferences provided the 
focus needed to address problems or 
issues and have considered means 
for making the single audit approach 
more effective. The conferences in- 
cluded representatives from both the 
public and private sector audit and 
user communities. 

GAO’s “Standards for Audit of 
Governmental Organizations, Pro- 
grams, Activities, and Functions” 
(the ‘Yellow Book’’)—discussed 
below in the section on audit stan- 
dards—provides that when one gov- 
ernment receives funds from several 
others and each has a continuing 
need for a basic financial and com- 
pliance audit, such audits should be 
made on an organization-wide or en- 
tity basis whenever feasible rather 
than on a grant-by-grant basis. The 
auditor reviews the internal controls 
of an entity instead of doing a de- 
tailed audit of each of its grants. This 
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single audit approach provides an 
improved audit base for performing 
additional selective audits to satisfy 
specific Federal, State, and local 
user needs. Selective audits may be 
needed for detailed compliance is- 
sues as well as to determine econ- 
omy and efficiency or program 
results. 

The single audit concept, however, 
is not yet a way of life in the govern- 
mental audit community. It is still 
evolving, and a number of problems 
remain to be resolved. 

GAO has begun a study to develop 
data on the number of single audits 
performed to date, the cost, who is 
doing them, the nature of the entity 
being audited, and the problems en- 
countered. Comparison will then be 
made with data from traditional audit 
coverage. 


GAO Establishes Internal 
Control Project 


GAO has established a project to 
improve understanding of govern- 
ment internal control standards. The 
project will help GAO carry out its 
responsibilities under the Account- 
ing and Budget Act of 1950. Since 
passage of the act, GAO has pub- 
lished accounting and auditing stan- 
dards for the Federal Government. 
Both sets of standards include ex- 
tensive coverage of internal controls. 
The standards of internal control, 


however, are contained in numerous 
other publications distributed over 
the last 30 years. 

The project will refine and con- 
solidate into a single document 
GAO’s policies and standards for in- 
ternal control. The result should be 
an important step toward achieving 
the objectives of proposed Federal 
Manager’s Accountability Act of 
1982, which is currently before the 
Congress. The objective of this leg- 
islation is to improve internal con- 
trols in the Federal Government by 
requiring agency heads to annually 
review and report on the adequacy of 
their internal controls. GAO is also 
consulting with several major public 
accounting firms to obtain their 
views on internal control standards. 


Orientation on Audit 
Standards Planned for 
GAO Professional Staff 


What are generally accepted 
government auditing standards? 
Why is it important to understand 
them? These questions will be an- 
swered in a 1-day audit standards 
orientation program to be given to 
GAO professional staff. 

Generally accepted government 
auditing standards are set forth in 
GAO’s Standards for Audit of Gov- 
ernmental Organizations, Programs, 
Activities, and Functions, better 
known as the “Yellow Book.” The 
standards incorporate statements 
on auditing standards of the Amer- 
ican Institute of Certified Public Ac- 
countants as well as additional stan- 
dards and requirements to satisfy 
the unique needs of government. 

The standards must be followed 
by all auditors—including those out- 
side GAO—for audits for Federal or- 
ganizations, programs, activities, 
functions, and funds. GAO reports 
must now Carry a statement that the 
review was performed in accordance 
with the standards. 

GAO issued the Yellow Book in 
1972 and revised it in 1981. Examples 
of important revisions are require- 
ments that the auditor must report 
on compliance and on internal con- 
trol. 
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Governmental Accounting 
Standards Board Update 


The Financial Accounting Founda- 
tion has appointed a committee to 
help implement the recommenda- 
tions made by the Governmental 
Accounting Standards Board 
Organization Committee (GASBOC) 
in its October 1981 final report. 
GASBOC confined its recommenda- 
tions to “relatively broad structural 
issues.” It proposed that a Govern- 
mental Accounting Standards Board 
be established under the existing 
Financial Accounting Foundation to 
issue pronouncements on State and 
local government accounting stan- 
dards. The implementation commit- 
tee will help the Financial Account- 
ing Foundation with its decisions on 
detailed operations, such as loca- 
tion, budget, and staffing. The Comp- 
troller General is a member of the im- 
plementation committee. 

For more information on the 
preceding sections of “Accounting 
Update,” contact Bruce Michelson, 
(202) 275-6222. 


Cost Accounting 


Standards Are 
Alive and Well 


In 1980, the Cost Accounting Stan- 
dards Board, after promulgating 19 
standards covering virtually all as- 
pects of contract costing, ceased its 
operation. GAO, in its oversight role 
of Government procurement, has 
always taken an active role to deter- 
mine whether Federal agencies and 
defense contractors were complying 
with the cost accounting standards. 
After the Board’s demise, GAO in- 
creased its efforts relating to these 
standards. For example, GAO recent- 
ly reported (PLRD-82-51) that Fed- 
eral agencies were effectively im- 
plementing the standards, although 
it did recommend that agency per- 
sonnel receive additional training in 
this area. 

To keep the dynamic world of con- 
tract costing current, many in the 
procurement field have recom- 
mended that a CAS maintenance 
function be established somewhere 
in the government. The Department 
of Defense contends, for example, 
that vital procurements might be 
jeopardized if Congress does not 
delegate the authority to exempt or 


waive certain defense contractors 
from the standards. Further, DOD 
and the defense industry have 
recommended the amendment or re- 
peal of Standard 409, ‘Depreciation 
of Tangible Capital Assets.” GAO is 
currently assessing the cost implica- 
tions of this potential action. For 
more information, call Clark Adams 
in the Procurement, Logistics and 
Readiness Division, (202) 275-4262. . 


Intergovernmental 
Audit Forums 


The Intergovernmental Audit 
Forums trace their beginnings to 
numerous discussions in the early 
1970’s on the need for better plan- 
ning and cooperation among Fed- 
eral, State, and local government 
audit organizations. In September 
1972, a group of State auditors and 
representatives from the Council of 
State Governments met with then- 
Comptroller General Elmer Staats 
and with other officials from GAO 
and the Office of Management and 
Budget (OMB) to propose national 
and regional audit forums. Within the 
forums, problems of mutual concern 
to auditors at different levels of 
government could be discussed. 

GAO provided leadership in the 
creation of the National and 10 
Regional Intergovernmental Audit 
Forums—a regional forum foi each 
of the 10 Federal regions. GAO’s Ac- 
counting and Financial Management 
Division provides administrative sup- 
port for all 11 forums. 

The National Forum includes rep- 
resentatives from GAO, OMB, Trea- 
sury, and all principal grantmaking 
Federal agencies as well as 10 State 
and 10 local government represen- 
tatives and observers from_inter- 
ested professional groups. The State 
and local government represen- 
tatives are selected from the 10 
regional forums. 

The most recent meeting of the 
forums took place in Nashville, Ten- 
nessee, on May 10-12, 1982. About 
200 people attended, including Fed- 
eral Inspectors General, auditors and 
audit directors from Federal, State, 
and local governments, and repre- 
sentatives of CPA firms throughout 
the United States and Puerto Rico. 
The theme of this conference was 
“Governmental Auditing in the 
1980’s.” 


These auditors met to discuss and 
solve current issues that affect the 
audit community. A side benefit that 
resulted from the conference was 
that relationships among auditors 
from all levels of government were 
strengthened. 

The conference’s keynote address 
was given by Joseph R. Wright, Jr., 
Deputy Director, Office of Manage- 
ment and Budget. Subjects dis- 
cussed in plenary sessions and 
workshops at the conference _in- 
cluded block grants; single audits; 
financial management systems; 
fraud, abuse, and illegal acts; cash 
management; and improving the ef- 
fectiveness of the audit forums. 

Charles Bowsher, Comptroller 
General of the United States, sent 
correspondence to the conference 
participants since he was unable to 
attend. Mr. Bowsher noted that the 
Intergovernmental Audit Forums 
have played an important role in im- 
proving the auditing and overall 
financial accountability of Federal 
Government programs. He said that 
the audit forums have become a 
recognized body of governmental 
audit officials that can be depended 
on more and more for resolving prob- 
lems in the complex areas relating to 
audit and that he looks forward toa 
continued spirit of cooperation with 
the forums. For more information, 
contact Joel Fields, (202) 275-5200. 


New Federal Entities 
Created; Old Ones 
Abolished 


Are you wondering what became 
of the Community Services Admin- 
istration (CSA)? Are you searching 
for an expert to interview on 
aquaculture? 

The annual list prepared by the Of- 
fice of the Federal Register can pro- 
vide some leads. Each January, the 
Register compiles a list of Federal 
agencies and commissions created 
or abolished by the President or the 
Congress. According to the January 
1982 list, Congress abolished CSA 
and the Council on Wage and Price 
Stability and created the Aquacul- 
ture Advisory Board, the Community 
Investment Advisory Board, and the 
Soybean Research Advisory Insti- 


See BRIEFCASE, p. 57 
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GAO’s Frank Davis (r.) accepts the Excalibur Award from Congressman Mike Barnes. 


GAO Outplacement 
Officer Wins Excalibur 
Award 


In a Capitol Hill ceremony on 
June 8, 1982, Frank Davis, GAO’s 
Outplacement Officer in the Office 
of Organization and Human Devel- 
opment, received the Congressional 
Excalibur Award for excellence in 
public service. He is the first GAOer 
to be so honored in the five occa- 
sions on which the award has been 
given. With the Comptroller General 
and other GAO officials, his co- 
workers, and Members of Congress 
looking on, Rep. Michael D. Barnes 
(D-Md.) presented Davis with an 
engraved plaque, citing him .. .“for 
services rendered to the United 
States Government and to its citi- 
zens. Your efforts provide an exam- 
ple of dedication and public service 
of the highest level that is truly in- 
spirational.” 

Rep. Barnes established the 
award program in 1979 to em- 
phasize the positive aspects of 
Government service. The objectives 
of the Excalibur Award are to 

® recognize and honor outstand- 


ing contributions made by Federal 
civilian and military personnel, 

e encourage initiative and ex- 
cellence in performance by Govern- 
ment employees, 

e publicize such achievements 
and enhance public appreciation of 
the merit and performance of Gov- 
ernment employees, and 

e help attract talented persons to 
the Federal service. 

Davis, who started at GAO 28 
years ago as a GS-1 messenger, was 
honored for his accomplishments in 
assisting GAO’s managers by pro- 
viding outplacement service to 
GAO’s employees. 

In recommending Davis for the 
award, Comptroller General 
Bowsher said, 

“He has successfully assisted on 
the average of 200 employees per 
year with career placement in both 
governmental agencies and private 
industry and has personally con- 
ducted counseling sessions with 
over 600 employees during the past 
few years.” 

In addition, his work has _ in- 
volved—on his own time and at per- 
sonal expense—conducting numer- 
ous workshops on changing em- 
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ployment and career development 
to such diverse groups as the Na- 
tional Association of Accountants 
and Gallaudet College. Davis is very 
active in his church and community. 
An accomplished athlete, he par- 
ticipates in various sports programs 
and teaches and coaches sports for 
young people. Mr. Davis is also 
known for his poetry readings in the 
Baltimore-Washington metropolitan 
area. He devotes any spare time to 
reading in his professional field. 


Seminar participants listen as Thomas McBride (standing), Inspector General of the 


Department of Labor, describes his role. 
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Chinese visitors pose in Comptroller General’s conference room. From left, Xu Wenqging; Zhang Shengman; Elaine Orr, 
Office of Foreign Visitors Director,(OFV); Song Xinzhong; Carol Codori, Acting Special Assistant, OFV; Zhang Yansheng; Sheng 
Huandeh; and Assistant Comptroller General John Heller. 


GAO Welcomes 
Officials from The 
People’s Republic of 
China 


A delegation of senior officials 
from The People’s Republic of 
China visited GAO from May 17-28, 
1982, to study the organization of 
GAO’s audit function, its statutory 
authority, and the kind of work done. 
The participants were Mr. Song 
Xinzhong, Director, Budget Depart- 
ment, Ministry of Finance (delega- 
tion leader); Mr. Zhang Yansheng, 
Deputy Director, Supervisory De- 
partment, Ministry of Finance; Mr. 
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Sheng Huandeh, Accountant and 
Deputy Division Chief, Ministry of 
Finance; and Mr. Xu Wenging, Dep- 
uty Division Chief, State Planning 
Commission. Mr. Zhang Shengman, 
an official of the Ministry of Finance 
who is currently on a 2-year assign- 
ment with the World Bank in Wash- 
ington, served as the group’s inter- 
preter. 

This recent interest in the U.S. 
audit system stems from the fact 
that, under its new constitution, The 
People’s Republic of China is to 
establish a national government au- 
dit office. Mr. Song, the leader of the 
delegation, is charged with this 
responsibility. 


The delegation participated in nu- 
merous briefings conducted by GAO 
senior staff in such areas as ag- 
ricultural and rail activities, private 
enterprise audits, fraud-related 
work, and auditor training. They also 
toured Capitol Hill and met with 
Comptroller General Bowsher. On 
May 24, the group visited GAO’s 
audit site at the District of Columbia 
government and heard presenta- 
tions on how the city is audited by 
both GAO and a private accounting 
firm. From May 25-28, they visited 
the New York regional office, learn- 
ing more about regional office oper- 
ations and staffing. There they also 
had an opportunity to contrast their 
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During a tour of GAO’s publication 
facilities, Zhang Shengman (third from 
r.) interprets a step in GAO’s report print- 
ing process while Bill Chapman, 
Manager of GAO’s Document Produc- 
tion Branch, OAPS (front), and Chinese 
visitors look on. 


Zhang Shengman (third from r.) inter- 
prets as Bill Chapman (second from |.) 
displays printed pages ready for bind- 
ing. 


GAO and D.C. audit information 
with audit activities at offices of the 
New York City and State Comp- 
trollers. 

Many GAO staffers assisted with 
arrangements for briefings, tours, 
and social events. Those with a 
knowledge of Mandarin helped 
translate such documents as week- 
ly agendas and briefing outlines. 


Philadelphia Staffer 
Wins 1982 Outstanding 
Handicapped Federal 
Employee Award 


Eva Ball, lead clerk-typist in the 
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Philadelphia regional office, was 
GAO’s nominee for the 1982 Outstan- 
ding Handicapped Federal Employee 
Award. In September 1982, GAO was 
notified that Ms. Ball was one of the 
10 cowinners of this award, selected 
from a field of 67 nominees. 

Eight years ago, at 19, Ball 
discovered she had malignant bone 
cancer in her right knee. At the 
Sloan-Kettering Cancer Institute in 
New York, she underwent chemo- 
therapy and an 8-hour operation to 
replace her knee and thighbone with 
steel artificial bone. 


Ms. Ball joined the Philadelphia 
regional office 3 years ago as a 
receptionist and was recently pro- 
moted to her present position as lead 
clerk-typist. According to regional 
manager Ralph Carlone, who nomi- 
nated Eva for the Federal award, “‘her 
flawless and good-humored work as 
our receptionist is the more remark- 
able considering that she suffers 
pain in her leg more than half the 
time ... She is now responsible for 


Philadelphia staffer Eva Ball. 


training and supervising four clerk- 
typists and for training her replace- 
ment as receptionist. She will show 
them how to use new automated 
equipment and has been named ad- 
ministrative representative for the 
new electronic work stations.” 
“Disabled though she may be,” 
Carlone’s nomination concluded, 
“this young woman is more con- 
scientious and industrious than 
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many of her colleagues who are not 
physically impaired.” 

Eva and her nine cowinners re- 
ceived their awards in an October 
ceremony held at the Office of Per- 
sonnel Management. We offer our 
congratulations on her award and 
our thanks for all her efforts. 


Charles Wolfe: 47 
Years, 6 Comptrollers 
General 


Mr. Charles W. Wolfe, an evaluator 
in GAO’s Washington regional office, 
has the distinction of being the only 
GAO employee to serve under all six 
Comptrollers General. Charles 
Bowsher, Comptroller General since 
1981, met with Mr. Wolfe on May 13, 
1982, to offer his personal con- 
gratulations. Stating that “This agen- 
cy Owes you a lot,” Mr. Bowsher ex- 
pressed his appreciation for Mr. 
Wolfe’s 47-year career with GAO. The 
two then posed for photographs to 
mark the occasion. 


Charles Wolfe (I.) marks his 47-year career 
with GAO by meeting with the Comptroller 
General. 


Charles Wolfe began his GAO ca- 
reer on April 29, 1932, as a GS-1 
junior typist. At that time, GAO’s of- 
fices were located in the Pension 
Building, across the street from the 
present GAO Building at 441 G 
Street, N.W. “It was the height of the 
Great Depression, and | couldn't find 
a job in Oklahoma,” he remembers. 
“| passed the Government test and 
started with GAO in Washington at 
$1,200 a year—a princely sum in 
those days,” he said with a chuckle. 
“Back when | started doing reports, 
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we didn’t have any manuals at all. 
We didn’t have referencing, editing, 
agency comments, draft reports, 
workpapers, or reviews. We just did 
the job and typed the report in final.”’ 

He shares an anecdote from his 
long career: ‘In 1938 in the Boston 
regional office, two of us had just 
finished a 3-week job inspecting 10 
collection accounts. Those inspec- 
tions were the forerunners of today’s 
financial compliance audits. Well, 
we had finished the final 10 reports, 
10 pages each, and we left them on 
the windowsill to wait for signatures. 
The supervisor came in and said, 
‘Don’t you think it’s hot in here?’ He 
opened the window, and at that mo- 
ment, the strongest gust of wind that 
ever hit Boston came along and blew 
all 100 pages out the window! We 
raced down the street and caught 
some of the papers, but we didn’t get 
all of them. In the end, we had to do 
some of the jobs over. When | fin- 
ished typing those reports, | put them 
inside my desk!” 

We join with Mr. Bowsher in con- 
gratulating Charles Wolfe on this 
remarkable career. 


Public and Private 
Sectors Meet To 
Tackle Delinquent 
Debts 


On February 24 and 25, 1982, over 
600 representatives of Government 
and industry met at a 2-day con- 
ference in Washington, D.C., to 
discuss ways in which industry can 
help the Government cope with its 
debt collection problems. 

GAO sponsored the conference 
under the stewardship of the Ac- 
counting and Financial Management 
Division’s Claims Group. At the start 
of fiscal year 1982, individuals and 
organizations owed the Government 
more than $180 billion—a 45 percent 
increase since 1980. About $33 
billion of these debts were delin- 
quent, and agencies have been writ- 
ing off as uncollectible more than $1 
billion annually. 

In recent years, GAO has been ad- 
vocating that Government agencies 
adopt private industry practices, 
such as fully using the services of 
commercial credit bureaus and col- 
lection agencies, as one way of in- 
creasing the collection of overdue 
debts. In April 1981, the President 


Comptroller General Bowsher introduced Edwin Harper, then Deputy Director of OMB, 
to the conference. Mr. Harper was recently appointed Assistant to the President for 


Policy Development. 


directed agencies to take a more ag- 
gressive stance in collecting money 
due the Federal Government. Around 
the same time, GAO and the Depart- 
ment of Justice completed a revision 
of the Federal Claims Collection 
Standard, which encourages Federal 
agencies to contract for help in col- 
lecting overdue debts. 

Keynote speakers at the con- 
ference included Senator Charles H. 
Percy, Comptroller General Charles 
A. Bowsher, Office of Management 
and Budget Deputy Director Edwin L. 
Harper (now Assistant to the Presi- 
dent for Policy Development), and 
Acting Director of GAO’s Accounting 
and Financial Management Division, 
Wilbur Campbell. Jerry F. Wilburn, 
Claims Group, organized and chaired 
the event. 

A conference objective was to 
educate Government and industry 
representatives on each other’s 
capabilities, requirements, and con- 
cerns. Panel discussions and work- 
shops involving over 50 Government 


x. 


Senator Charles Percy was the keynote 
speaker for the 2-day event. GAO staff 
have worked wiih the Senator’s staff 
since 1979, proposing most of the key 
provisions of the Senator’s comprehen- 
sive debt collection legislation. 


AFMD acting director W.D. Campbell (I.) and conference chairman Jerry Wilburn, also 


from AFMD (r.), pause with Comptroller General Bowsher during the conference. 
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and industry experts focused on (1) 
actions Government agencies are 
taking to improve debt collection, (2) 
legal constraints, such as_ the 
Privacy Act and restrictions on using 
data obtained from the _ Internal 
Revenue Service, (3) the Canadian 
Government’s experience in using 
private debt collection services, (4) 
Government contracting procedures, 
and (5) services available from the 
private sector. Over 20 private firms 
contributed trade exhibits showing 
their services available to Federal 
agencies, and conference attendees 
were able to tour the facilities of 
several firms and Government agen- 
cies. 

Congressional aides were close 
observers of the proceedings since 
some 15 bills have been introduced 
in the current Congress, each 
prompted by concern over the Gov- 
ernment’s mounting delinquency 
problem. GAO has been actively 
supporting much of the pending 
legislation which will give Govern- 
ment agencies additional tools they 
need to deal with the problem. 

As an outgrowth of GAO’s involve- 
ment, an association of Federal col- 
lection officials is forming and will 
meet informally to share experiences 
much like its counterparts do in in- 
dustry. One of the group’s goals is to 
increase the stature of those of- 
ficials who are responsible for such 
a sizable and ever-increasing share 
of Federal funds so that the repay- 
ment of Government monies receives 
the attention it deserves. 


Field Office Division 
Holds Annual Meeting 


Regional office managers met at 
GAO’s Management Development 
Center in Georgetown on May 17-24, 
1982, to discuss regional office 
operations. GAO’s foreign branch 
managers also were invited. Mr. 
Bowsher and Messrs. Socolar, 
Heller, and Havens—top Compiroller 
General staff—joined the group on 
May 17. During the week, attendees 
heard presentations on the status of 
the personnel systems development 
project, electronic work stations, and 
ongoing training. 

During the break, Vic Lowe, direc- 
tor, Far Eastern Branch/Honolulu, 
and Carol Codori, GAO Review as- 
sistant editor, discussed ‘‘center- 
fold policies” for a profile on FEB, 
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Vic Lowe and Carol Codori examine an 
issue of the GAO Review. 


scheduled to appear in the Winter 
issue of the Review. Editor John 
Heller advised his former boss that 
centerfolds are taboo! 


Comptroller General's 
Consultant Panel 
Meets 


On May 18 and 19, 1982, the first 
Comptroller General’s Consultant 
Panel headed by Mr. Bowsher met at 
the General Accounting Office. The 
Consultant Panel is a source of out- 
side advice and support for many of 
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the Office’s initiatives. 

New additions to the panel in- 
cluded Theodore C. Barreaux, 
American Institute of Certified Public 
Accountants, Washington, D.C.; 
James Bruce Cardwell, Blue Cross/ 
Blue Shield Association, Chicago; 
James J. Macdonell, Chairman, 
Canadian Comprehensive Auditing 
Foundation, Ottawa, Ontario; Vice 
Admiral Raymond E. Peet, USN 
(Ret.), Teledyne Ryan Aeronautical, 
San Diego; and Donald A. Petrie, 
Lazard Freres & Co., New York City. 

Topics discussed during the meet- 
ing pertained to GAO’s involvement 
in the budget process through assis- 
tance to Congress, the development 
of a new personnel system for GAO, 
and individual department and agen- 
cy reviews. 


International Auditor 
Fellows Attend 1982 
GAO Program 


GAO once again welcomed a 
group of auditors—15 of GAO’s inter- 
national counterparts—to its 4th In- 
ternational Auditor Feilowship Pro- 
gram. The July-October program 
gave participants an overview of 
GAO’s work and specialized training 
in auditing techniques. 

The participants, or Fellows, at- 
tended numerous classes, briefings, 
and tours and spent time with GAO 
audit site and regional office staff. 


Joao Domingos Wolff Da Silva and Yvonne MacDonald, evaluator, HRD (foreground) 
and Thomas Mbelu and Frank Conahan, director, ID (background) chat during BIG 


reception. 
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Front row, I. to r.: Srisuda Achavanuntakol, guest student, Thailand; Joao Domingos Wolff Da Silva, Brazil; Boobpha Anuntawat, 
Thailand; Ali Mohammed Abdullah Qassem, United Arab Emirates; Joseph G. Tabone Adami, Malta; Javaid Akhtar Sheikh, Pakistan. 
Middle row, |. to r.: Ray Wyrsch, guest instructor, OGC; Sung-Dae Ro, Korea; Felicitas C. Ona, Philippines; D.G. Pathirana, Sri Lanka; 
Lee Eng Bok, Singapore; Thomas Mbelu, Swaziland; Samuel Maluki, Kenya; Argimiro Alonso Fernandez, Spain. Back row, I. to r.: 
Harry Ostrow, head instructor, PLRD; Hassan N’Dogal Sowe, Gambia; Moussa Taujoo, Mauritius; Jose Luis Alfaro Sanchez, Mexico. 


Fellows were assigned sponsors 
who helped them become ac- 
quainted with life in Washington, 
D.C., and at GAO. 

During the program, the Fellows 
also were entertained by several 
groups, including the Blacks in 
Government (BIG) chapter at GAO, 
which hosted a welcoming recep- 
tion on August 4, 1982, in the Comp- 
troller General’s dining room. In ad- 
dition, the Fellows, a guest student, 
and GAO instructors worked together 
from August 9-13, 1982, to complete 
an intensive Operational Auditing 
course, especially tailored to the 
Fellows’ interests and needs. 


Mr. Bowsher, Hazel Cooke, Ozell Simmons, and Ryan Yuille listen as Aletha Brown (far 
left) welcomes Fellows to GAO during BIG reception. 


* 


Joseph G. Tabone Adanii, left, discusses an issue with Mr. Bowsher during BIG reception. 
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From The Editor 


In the past year, the GAO Review 
lost two of its key staff members, Art 
LaMay and Hannah Fein. We’d like to 
acknowledge their contributions to 
the magazine by presenting these 
short profiles: 


A 
Art LaMay 


Art LaMay, head of GAO’s 


Graphics Branch and the graphics 
chief for the GAO Review, left the 
agency on August 27, 1982, to pursue 


a full-time, freelance art career. 

Art joined GAO 11 years ago as an 
illustrator and served as the Graph- 
ics Branch manager for the past 5 
years. During his tenure as manager, 
Art expanded the branch by estab- 
lishing GAO’s in-house darkroom, 
staffed by a full-time photographer; 
by upgrading existing graphics 
equipment and installing new pieces; 
and by implementing the Graphics 
cooperative education program, 
which allows art students to work at 
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Hannah Fein 


GAO for college credit. (For the past 
2 years, GAO has won an award from 
Northern Virginia Community Col- 
lege for the agency’s dedication to 
the co-op program). During his GAO 
career, Art received several agency 
awards, including the Director’s 
Award from the Office of Publishing 
Services. 

Art LaMay is a talented wildlife ar- 
tist with a national reputation for his 
paintings of wildfowl. He generally 
paints in watercolors, although he 
has worked with oils and several oth- 
er media. Art has also judged the 
World Championship of Wildfowl Art 
and Carving and actively exhibits his 
work at selected galleries and com- 
petitions on the East Coast. Owners 
of Art LaMay’s paintings include ac- 
tresses Elizabeth Taylor and 
Amanda Blake; former governors 
John Connally (Texas) and Marvin 
Mandel (Maryland); Al Davis, owner 
of the Oakland Raiders; and Bert 
Jones, quarterback for the Los 
Angeles Rams. 

Art and his wife Bonnie will spend 
the next few months in Rehoboth 
Beach, Delaware, and will make a 
permanent move to Daytona Beach, 
Florida, in March 1983. 


We would also like to note the 
departure of Hannah Fein, the 
Review’s Assistant Editor. Hannah, 
who was with GAO for 7 years, will 
be doing freelance work for the 
Review, the Annual Report, and other 
GAO publications. 

During her career, Hannah helped 
launch the comprehensive GAO 
writing program, including the 
POWER course. As a writer/editor, 
she worked to promote the involve- 
ment of writer/editors in the early 
stages of report writing. While Assis- 
tant Editor, Hannah inaugurated a 
new Review series entitled, “A Dif- 
ferent Perspective: Intergovern- 
mental Auditing and Evaluation,” 
which provides State and local 
perspectives of auditing roles and 
functions. She also took the lead in 
preparing the readership survey 
published in the Summer 1982 GAO 
Review. 

The Review staff would like to 
thank Art LaMay and Hannah Fein 
for their service to the magazine, and 
we wish them every success in their 
new Careers. 





Topics in Evaluation 


This issue’s topic is Statistics for 
Evaluation. 


The science of statistics provides 
ways of summarizing information 
and drawing inferences about phe- 
nomena when we have only partial 
information. Both descriptive sum- 
marization and inferential reasoning 
make statistical analysis an impor- 
tant, if not indispensable, compo- 
nent of evaluation when the phenom- 
ena are government programs and 
activities. 

An evaluator, like anyone who 
deals with empirical data, needs a 
set of tools for analyzing these phe- 
nomena. And statistics are among 
the most common tools in the evalu- 
ator’s kit. Because a statistic is 
simply a quantity calculated from 
observations, one can easily learn 
how to compute many different kinds 
of statistics. But learning their prop- 
er and fair use proves difficult. That 
difficulty may be what gave rise to 


Carl E. Wisler 


Mr. Wisler is an associate director in the In- 
stitute for Program Evaluation. 


Disraeli’s famous observation, 
“There are three kinds of lies: lies, 
damned lies, and statistics.” 

Given the importance of statistics 
to evaluation and being mindful lest 
we mislead either ourselves or oth- 
ers, evaluators need to be quite con- 
versant with statistical tools. An in- 
ventory of some of the most fre- 
quently used tools may serve as an 
introduction or refresher for evalu- 
ators who are not statisticians by 
training. This inventory has three 
parts: descriptive statistics, inferen- 
tial statistics, and techniques for ex- 
ploratory data analysis. The accom- 
panying table gives some examples 
of statistics for each of these 
categories. 


Descriptive Statistics 


An evaluation produces a set of 
observations. To the extent that the 
observations are quantitative, de- 
scriptive statistics can be used to 
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summarize and understand an other- 
wise incomprehensibly large amount 
of information. 

To illustrate, consider a long list of 
numbers—say the dollar amounts of 
a thousand Medicare reimburse- 
ments. To interpret such a list, one 
needs to know how big (or small) the 
numbers tend to be. The group of 
Statistics called measures of central 
tendency are designed to provide 
just such help. The most commonly 
used Statistic from this group is the 
mean, but other familiar indicators 
are the median and the mode. (The 
median is that value which is greater 
than half the numbers in the list. The 
mode is the most frequently appear- 
ing number in the list.) 

In addition to the central tendency 
of a list of numbers, one needs to 
know how much dispersion exists 
among the numbers. Another group 
of statistics serves that purpose: the 
variance, the standard deviation, the 
range, and others. (The variance is 
determined by computing the dif- 
ference between the mean and each 
number in the list, squaring the dif- 
ference, and then averaging the 
squared differences. The standard 
deviation is the square root of the 
variance. The range is the difference 
between the largest and smallest 
numbers on the list.) 

Despite their value in describing 
government programs and activities, 
measures of central tendency and 
dispersion do not answer questions 
about the relationship between two 
variables. For example, if we want to 
know how Medicare reimbursements 
relate to claimants’ incomes, we 
need a different kind of statistic, one 
which indicates the degree to which 
variation in one measure corre- 
sponds to variation in the other. The 
most common statistic of this kind is 
Pearson’s product-moment correla- 
tion coefficient, but there are many 
other measures of association, in- 
cluding the covariance and the 
regression coefficient. 

Had Disraeli not spoken about lies 
and statistics long before the inven- 
tion of regression analysis, one 
might suppose that the British 
statesman had regression coeffi- 
cients in mind. Too many research- 
ers have implied, either directly or 
implicitly, that regression coeffi- 
cients measure the extent to which 
one variable causes ancther. |n this 
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way, one might find a regression co- 
efficient relating Medicare reim- 
bursements and claimants’ income 
introduced as evidence to argue that 
income at least partially determines 
reimbursements. With regression 
analysis as it is usually employed, 
such an argument is indefensible. 
Regression analysis, however, is a 
general purpose tool. In conjunction 
with particular evaluation designs or 
with carefully formulated questions,’ 
the resulting regression coefficients 
can be used to draw conclusions 
about causality. The point is that if 
Statistical tools are applied inap- 
propriately, they produce informa- 
tion worse than damned lies. 

Until now, we have assumed that 
the observations to be summarized 
represent a continuous variable, i.e., 
a variable which, in theory, can take 
on all possible values in a given inter- 
val. Although, strictly speaking, 
dollars paid out in Medicare reim- 
bursements are not a continuous 
variable, they can be regarded as 
one. When the observations fall into 
several categories rather than along 
a continuous dimension, we need dif- 
ferent statistical tools. Suppose, for 
example, that the observations only 
tell whether a reimbursement is less 
or greater than $350. Statistics of in- 
terest are then the proportion of 
reimbursements in the two cCate- 
gories. Such statistics are easily ex- 
tended to more than two categories. 

Evaluative questions often involve 
comparing two or more groups of 
observations. Usually, the groups 
will be compared on measures of 
central tendency, proportions, or 
measures of dispersion. Imagine a 
hypothetical situation where claims 
for Medicare reimbursement can be 
processed in two distinctly different 
ways. To see if reimbursement under 
one procedure tended to be higher 
than under the other, one could com- 
pare simple statistics like the mean 
reimbursements under each pro- 
cedure. For reasons beyond the 
scope of this article, comparisons 
between simple descriptive statis- 
tics, such as the mean and variance, 
usually have limited value in evalua- 
tions. Comparisons are more likely 
to be made between “adjusted” 
means. 


Inferential Statistics 


So far we have been concerned 


Topics in Evaluation 


about statistics that summarize a set 
of observations where all par- 
ticipants in a group have been 
observed. Frequently, our goal is 
more ambitious. Often, our observa- 
tions are but a sample from a much 
larger set of possible observations. 
The thousand Medicare reimburse- 
ments might be a sample from 
among all 100,000 reimbursements 
(the population) made in a given time 
period. Under these circumstances, 
one typically seeks a measure of the 
central tendency among the 100,000 
numbers, using only our sample of 
1,000 or some other sample. This 
measure, called a population es- 
timate, introduces the field of in- 
ferential statistics. 

The basic idea is to use a sample 
from a population to draw conclu- 
sions about that population. In the 
Medicare example, we could, in prin- 
ciple, observe each of the 100,000 re- 
imbursemenis and exactly determine 
the population mean. But that pro- 
bably would be expensive and pro- 
duce an unnecessarily precise 
answer. Using a sample is better, 
provided that we (1) draw a sample? 
in a way which will allow us to use 
established principles of statistical 
inference, and (2) accept uncertainty 
about the true value of the popula- 
tion mean. Usually these require- 
ments are a small price to pay in ex- 
change for the dollar savings from 
making fewer observations. 

With appropriately drawn sample 
observations, one can compute sta- 
tistics to estimate the central 
tendency, dispersion, and other in- 
formation about populations or 
groups of populations. There are two 
broad categories of population esti- 
mates: point estimates and interval 
estimates. Point estimates are our 
“pest guess” of ihe population 
measure we are interested in. For ex- 
ample, the mean of our Medicare 
sample might be taken as the best 
guess of the mean of the population. 
Almost surely, however, the sample 
mean will not equal the population 
mean because of the vagaries of 
sampling. Consequently, evaluators 





'See, for example, IPE’s Methodology 
Transfer Paper #1, where regression analy- 
sis plays a deliberately stipulated role in the 
causal analysis of nonexperimental data. 

2A discussion of sampling, though ob- 
viously linked closely to statistical estimates, 
is-outside the scope of this article. 
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want an interval estimate as well. An 
interval estimate says that the pop- 
ulation mean lies somewhere be- 
tween two numbers, say $323 and 
$348, with a certain probability. The 
interval estimate allows us to be pre- 
cise (the probability) about our uncer- 
tainty (the interval within which the 
mean falls), while the point estimate 
gives no clue about the degree of 
uncertainty. 

After point and interval estimates, 
a third kind of tool used in inferential 
Statistics is the test statistic. This 
group of statistics helps settle vari- 
ous propositions about a population 
based only on information about a 
sample from the population. For ex- 
ample, is the sample data compati- 
ble with the proposition that the 
mean of the 100,000 Medicare reim- 
bursements is $340? Or is the sam- 
ple data compatible with the proposi- 
tion that, in the population, the cor- 
relation between reimbursements 
and income is zero? Test statistics 
provide a way to examine these 
kinds of questions. 

Test statistics are also used to ex- 
amine those questions, so common 
to evaluation, about differences be- 
tween groups of observations. The 
earlier example of making Medicare 
reimbursements by two different pro- 
cedures illustrates this point. Sup- 
pose that we have appropriate sam- 
ples of reimbursements using each 
procedure. Comparing sample 
means, should we infer that the pop- 
ulation mean reimbursements re- 
sulting from the two procedures are 
different? Putting aside the ques- 
tions of how to design an evaluation 
to examine this proposition, the sta- 
tistical task in this case boils down 
to computing a particular test sta- 
tistic—the t-statistic. Although the 
sample means almost always differ, 
that alone does not mean the pro- 
cedures yield different results. 
Nevertheless, knowing the t-statistic 
helps decide whether a sample dif- 
ference is due to sampling fluctua- 
tions or to real differences between 
the two reimbursement procedures. 

A wide variety of test statistics ap- 
plies to different evaluation designs 
and conditions. Among the most 
common are an F test for the dif- 
ferences between means, a Z test for 
the possibility that a correlation co- 
efficient is different from zero, anda 
chi-square test of the relationship 
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between two categorical variables. 


Exploratory Data 
Analysis 


Exploratory data analysis refers to 
both a state of mind and a collection 
of techniques. Traditionally, statis- 
tical analysis has stressed precision 
and formalisms, emphasizing rigor- 
ous Statistical tests to confirm or re- 
ject propositions about observa- 
tions. Explortaory data analysis 
(EDA) assumes that formal statis- 
tical analysis can often prevent our 
understanding the data. 

To avoid the constraints of statis- 
tical formalisms, proponents of EDA 
have developed their own techniques 
for dealing with data. Because these 
techniques have an investigative or 
searching flavor to them, EDA may 
be especially suitable for certain 
kinds of evaluations. 

Many EDA techniques are visual, 
and almost all are best explained us- 
ing real data to illustrate the ideas. 
Due to space limitations, we shall 
limit our examples to two. 

A box-and-whisker plot is a picture 
of the central tendency and disper- 
sion of observations on a single var- 
iable like Medicare reimbursements. 


The vertical line within the box rep- 
resents the location of the median 
for a set of observations. Half of all 
observations are within the box; one- 
fourth between the median and the 
left side of the box and one-fourth 
between the median and the right 
side. The width of the box is called 
the midspread. The X’s mark those 
observations which are most distant 
from either end of the box but within 
one midspread of the ends. The dot- 
ted lines connecting the X’s to the 
box are known as whiskers. Any ob- 
servations beyond the X’s are 
marked as individual circles. Aside 
from the simple pictorial summary 
which it provides, analysts like the 
box-and-whisker plot because the 
median and the midspread are less 
affected by extreme-valued observa- 
tions than are the more traditional 
measures of mean and standard 
deviation. 

Procedures for dealing with ex- 


tremely large or small observations 
are common in EDA. Such observa- 
tions are a problem because one or 
two extreme values in a sample can 
drastically affect statistical analysis 
using traditional statistics such as 
the standard deviation. EDA prefers 
statistics which are resistant to ex- 
treme values. An example of a resis- 
tant statistic used in EDA is the 
“trimmed mean” or the mean of the 
observations remaining after a fixed 
percentage of the largest and small- 
est values are dropped. 

vohn Tukey, a prominent statisti- 
cian, has characterized exploratory 
data analysis as numerical and 
graphical detective work. In that 
spirit, EDA techniques belong in the 
evaluator’s tool kit. 


Calculating Statistics 


If the number of observations is 
not too large, some statistics are 
easily figured out by hand or with a 
calculator. Often, however, comput- 
ers are the best recourse. Several 
standard statistical packages com- 
pute all the traditional statistics. 
These packages of computer pro- 
grams include SPSS, SAS, and 
BMDP. In a much more limited way, 
EDA techniques are also available in 
these packages (e.g., box-and-whisk- 
er plots and stem-and-leaf displays 
in SPSS, trimmed mean and Winsor- 
ized mean in BMDP). 


For More Information 


Andrews, F.M., et al. A Guide for 
Selecting Statistical Techniques for 
Analyzing Social Science Data: Sec- 
ond Edition. Ann Arbor, Michigan: In- 
stitute for Social Research, 1981. 


A most useful map of the statis- 
tical territory. 


Fitz-Gibbon, C.T. and Morris, L.L. 
How to Calculate Statistics. Beverly 
Hills: Sage Publications, 1978. 


Exceptionally detailed instruc- 
tions on how to calculate statistics 
often used in evaluation. 


Hartwig, F. Exploratory Data Analy- 
sis. Beverly Hills: Sage Publications, 
1979. 


A brief introduction to EDA. 





See TOPICS, p.57 
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Manager’s Corner 


“Manager’s Corner” provides in- 
formation on current management 
theory and practice. Its purpose is to 
expand the knowledge and skills of 
GAO executives by increasing their 
awareness of management problems 
and achievements. 

For this edition of ‘“Manager’s Cor- 
ner,” several members of the Senior 
Executive Service read articles on 
motivation and wrote summaries. 

Because productivity seems to be 
slowing and because of changes in 
the working population, motivating 
employees has become a more com- 
plex task than in the past. The follow- 
ing articles explore these complex- 
ities both in the public and private 
sectors. 

*For full citations, see bibliogra- 
phy on motivation at end of article. 


*“Employee Recognition: A Key to 
Motivation.” By Margaret Magnus. 
Reviewed by William D. Martin, Jr. 


Every level of management in ev- 
ery employment sector is faced with 
two primary issues: Why is produc- 
tivity so low? How can productivity 
be enhanced? A related question is 
how can management increase em- 
ployee satisfaction and increase pro- 
ductivity? The author responds to 
these questions with a_ solution 
which can work in many cases: 
“Properly run recognition programs 
can boost awareness of the organi- 
zation, build employee pride, raise 
morale and, ultimately, increase pro- 
ductivity.” The point is made that 
raising a person’s salary is not al- 
ways the best answer. Even though 
such an action is appreciated, every- 
one’s pride is boosted by a public 
demonstration of appreciation. 

Once employee recognition pro- 
grams are established, however, they 
cannot remain static. Organizations 
must continually create different 
ways to recognize and reward em- 
ployees. In so doing, job enrichment 
and job development, along with per- 
formance appraisal, cannot be over- 
looked as part of the recognition pro- 
gram. 

The author has constructed the ar- 
ticle around comments made by nu- 
merous executives from a wide range 
of private sector organizations. This 
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technique adds to the understanding 
of why recognition programs are im- 
portant and what they hope to 
achieve. A distillation of these com- 
ments probably best sums up the ov- 
erall message of this article: Recog- 
nition programs single out individual 
achievements; it is the meaning that 
is attached to an award that is impor- 
tant; the program needs continuity; 
awards should be equitable; and, 
“the key factors in a job are the 
sense of responsibility, the desire for 
a sense of purpose, and recognition 
for a job well done.” 


*“Creating a Climate for Achieve- 
ment.” By Burt K. Scanlan. Reviewed 
by R.J. Woods. 


Research studies show that the 
average employee works at only two- 
thirds of capacity, and some work at 
only 20 to 30 percent. Professor 
Scanlan suggests that managers 
create a ‘climate of achievement” 
which will inspire people to achieve 
above these levels. This, he says, re- 
quires an understanding of (1) the 
characteristics of people who are 
high achievers, (2) the role the man- 
ager plays in the achievement moti- 
vation process, and (3) some of the 
operational aspects of achievement 
motivation. 

Four necessities for a ‘climate of 
achievement” are 

e explicit goals, 

e feedback to employees and 
positive reinforcement, 

¢ emphasis on individual respon- 
sibility, and 

e rewards based on results. 

Managers’ awareness of the con- 
cept of achievement motivation and 
continual analysis of the climate 
within their organizations can help 
assure the realization of maximum 
potential from human resources. 


*“Constraints to Effective Motiva- 
tion.” By John Nirenberg. Reviewed 
by W.D. Campbell. 


The author maintains that under- 
standing the principles of motivation 
is not enough. Managers must look 
at the organization and at their own 
managerial style to recognize ex- 
isting barriers to effective motiva- 
tion. 


The article lists four frequently 
found constraints: 

e supervisory attitude of super- 
iority, 

® organizational message of pro- 
ductivity treadmill, 

® supervisory bias toward staff, 
and 

© environmental factors perceived 
as demeaning. 

The author maintains that an as- 
sessment of current constraints is 
essential to any proposed motiva- 
tional program to ensure success. 


*“Ungluing the Stuck: Motivating 
Performance and Productivity 
Through Expanding Opportunity.” By 
Kanter and Stein. Reviewed by 
William J. Anderson. 


The July 1981 issue of Manage- 
ment Review contained an article 
that provides additional evidence, if 
any was needed, to support the the- 
sis that motivation and productivity 
problems are not all that unusual. 
The authors identify three situations 
that can put employees into ‘a non- 
productive and nonsatisfying rut.” 
These are, to use the authors’ terms, 
short-ladder jobs, the wrong route in, 
and the pyramid squeeze. 

“Short-ladder” jobs are those 
which peak out early in a worker’s 
career. The authors hold, not unrea- 
sonably, that in the absence of op- 
portunity for further advancement, 
short-ladder jobs do not provide in- 
centive for people to try to perform 
better or to master new tasks. 

The “wrong route in” describes 
situations where people are in an un- 
orthodox career path. Here the au- 
thors are referring to employees who 
advance in a specialty field suppor- 
ting the organization’s mainstream 
activities. The problem here is that 
the specialists’ opportunities peak 
out earlier than those in the main- 
stream, while at the same time it is 
extremely difficult for the high-level 
specialist to cross over to another, 
more promising ladder in line opera- 
tions. 

The last kind of rut is what the au- 
thors call the “pyramid squeeze.” 
Given the hierarchical pyramidal 
structure of most organizations, it 
follows, inevitably, that there is 
limited room at the top and that most 
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employees reach a wall in their pro- 
gression through the organization. 
The pyramid squeeze is aggravated 
when the organization is static and 
lacks the opportunities provided by 
expansion. 

From this article, | concluded that 
the most important concept is the 
need for managers at all levels to rec- 
ognize that people want to grow and 
want to advance. They do not want to 
feel that they have stagnated and 
that management has written off the 
prospect of further expanding an em- 
ployee’s contribution to the organ- 
ization. GAO managers need to real- 
ize that nearly all of our employees 
have a capacity and a desire for ca- 
reer growth, and managers should do 
what they can to provide a helping 
hand in this quest. 


*“Differentiating Organization Com- 
mitment from Expectancy as a Motiv- 
ating Force.” By Richard W. Scholl. 
Reviewed by William Thurman. 


This article addresses an issue of 
extreme importance to the stability 
of any public organization. It ex- 
plores the concept of employee com- 
mitment and argues that if commit- 
ment is viewed as a force distinct 
from generally accepted motivation 
models, it can help explain employee 
behaviors which are different from 
those which would be predicted 
based on equity theory and expec- 
tancy theory. 

Equity theory predicts that 
employees will compare their work 
contributions and rewards to those 
of their peers and that an employee 
will remain with an organization and 
continue to perform well so long as 
there is a reasonable balance be- 
tween their contributions and re- 
wards with those of others. Expec- 
tancy theory predicts that individuals 
will engage in behaviors they per- 
ceive will eventually lead to valuable 
rewards. Using a combined expec- 
tancy/equity model, one would ex- 
pect individuals to leave an organ- 
ization if their expectations of receiv- 
ing equitable and valued rewards are 
not met. But empirical studies have 
shown this model to be incomplete 
in explaining organizational stabili- 
ty, in that individuals remain even 
though their expectations are not 
met. 

Scholl argues that an alternate ex- 
planation of organizational stability 


14 


lies in the concept of commitment 
and that commitment acts as a force 
to maintain organizational stability 
even when expectancy/equity condi- 
tions are not met and do not func- 
tion. He identifies four different 
mechanisms which contribute to the 
commitment process: 


e Investments—Individual in- 
vestments, such things as age and 
tenure, can tie the individual to an 
organization. 

e Reciprocity—The tendency to 
leave will be reduced if leaving would 
harm an employee who has helped 
the individual in one way or another. 


e Alternatives—As experiences 
become more specific to a particular 
organization, the ability to leave 
decreases. 


e Identification—Work is a major 
source of status and identity for 
many individuals. As identity and 
status become embedded, it be- 
comes more difficult to leave. 

Thus, personal loyalties, length of 
service, and status are all factors 
which commit individuals to an 
organization. 


Motivation 
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“Anyone who enters the world of nu- 
clear weaponry and warfare strategy 
enters a Hades that is filled with 
more mystery and horror than any 
realm of perdition ever envisioned by 
the poet Dante. In that dark circle of 
damnation, one can hear the clap of 
atoms, see the vaporization of the at- 
mosphere and the instant incinera- 
tion of millions of people. Megatons, 
kilotons, hard target kill capability, 
circular errors of probability—this is 
all the phantasmagoria of men gone 
mad.” 


Senator William S. Cohen, 1980 


One of the most important and 
sensitive issues confronting the 
world today is the continuing buildup 
and potential use of nuclear wea- 
pons. The resulting debate is usually 
emotional and occurs ever more fre- 
quently around the globe. Never be- 
fore has so much information been 
available to the public concerning 
the potential use and destructive 
power of nuclear weapons. Never- 
theless, nuclear warfare remains an 
increasingly complicated issue. 

Whether or not ‘this is all the 
phantasmagoria of men gone mad,” 
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the strategies and war-gaming are 
the perceptions of reality of those 
who plan for and control nuclear 
weapons. The United States, the 
Soviet Union, and a growing number 
of other countries have both nuclear 
weapons and policies controlling 
their use. Every year the United 
States spends a portion of the 
defense budget on nuclear weapons 
that it hopes it will never have to use. 
And each year GAO audits and re- 
ports on the ability of these weapons 
to meet DOD’s objectives. 

Determining the objectives of U.S. 
nuclear weapons policy can be tor- 
tuous and confusing. Recently, ap- 
parent conflicts between the public 
statements of nuclear policy and op- 
erational capability of United States 
strategic weapons prompted a GAO 
review of the strategic mission area. 
Our review explored U.S. objectives 
and policy as perceived by those 
who make the decisions. The article 
presents some insight into the 
policies and objectives. 

Nuclear warfare remains a topic 
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for debate because, so far, there 
hasn’t been a nuclear war. Although 
many speculate on why nuclear war 
has not yet occurred, no one knows 
for sure. Short of war, the wide range 
of assumptions and conclusions 
cannot be tested or assailed by con- 
tradictory facts. One hopes, there- 
fore, that the debate might continue. 

We do not intend to enter the de- 
bate or to test any particular set of 
assumptions or conclusions. We will 
simply provide a primer on (1) the ob- 
jective of our nuclear strategy, (2) the 
factors that become important be- 
cause of the objective, (3) the evolu- 
tion of the U.S. approach to meeting 
this objective, and (4) the implica- 
tions of recent developments on 
weapon procurement. 
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Deterrence —The 
Rules of the Game 


Since World War Il, U.S. policy has 
sought to prevent a nuclear war by 
convincing potential enemies not to 
start one. This objective, commonly 
called deterrence, is actually quite 
complex. While nuclear weapons are 
obvious factors, other, more subtle 
factors may be more important. 

*Nhile reason, good will, and mo- 
rality may convince a_ potential 
enemy not to attack, the price of 
failure requires additional assur- 
ance. The United States, therefore, 
deters attack by creating fear of re- 
taliation. Successive administra- 
tions have sought to convince poten- 
tial enemies that, if attacked, we 
would so retaliate that either the at- 
tacker would fail or would suffer so 
much damage that he would gain 
nothing from his efforts. 

In deterring potential adversaries, 
perceptions are often more impor- 
tant than actual capabilities. A 
nuclear missile that will not fire re- 
mains a deterrent as long as the ad- 
versary thinks it will work. A decision 
to attack the United States would de- 
pend upon the attacker’s perception 
of our intentions and weapons capa- 
bility, not upon our assessment. Our 
capabilities, and our will to use them, 
must be obvious lest a potential ene- 
my’s miscalculation forces us to 
demonstrate them. 

The strongest deterrent available 
may be uncertainty. Despite exten- 
sive testing, exhaustive analysis, and 
endless computer modeling, no one 
knows what would happen if the 
complex interaction of offensive and 
defensive weapons were to be set in 
motion. While the United States and 
the Soviet Union talk about the 
general conditions that might cause 
them to use nuclear weapons, they 
never precisely define those condi- 
tions or specify their actions. 

For example, no one knows pre- 
cisely what deters the Soviet Union. 
Opinions range from the view that 
they would never use nuclear wea- 
pons to the belief that they will use 
them as soon as they think they can 
get away with it. While U.S. deter- 
rence has worked until now, we still 
do not know how much more—or 
less—will be needed in the future. 

Deterring the Soviets entails in- 
ducing the proper blend of under- 
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The Trident—a submarine-launched ballistic missile. 


standing and uncertainty. Policy 
statements broadly define the cir- 
cumstances under which we might 
use nuclear weapons. Soviet percep- 
tions depend on whether they think 
our nuclear and conventional 
weapons can back it up. 


Although deterrence focuses on 
nuclear weapons, one can enter the 
escalator that leads to nuclear war at 
any level. Hence, weaknesses in U.S. 
conventional forces could encourage 
the Soviets to try to exploit a situa- 
tion where they feel we cannot or will 
not prevent it. 


Finally, awareness of the potential 
for nuclear war permeates our rela- 
tionships with all other nations. The 
perceived status of the nuclear bal- 
ance and the perceived outcome of a 
nuciear war constitute the bottom 
line whenever U.S. and Soviet in- 
terests conflict. Friends and allies 
who rely on our nuclear capability to 


protect them from Soviet attack or 
coercion are understandably sen- 
sitive to apparent changes in our 
capabilities or intent. 


From Hiroshima to 
the Present 


While the basic objective of deter- 
rence has remained the same since 
World War Il, the policy and weapons 
needed to implement it have evolved 
to fit the changing international sit- 
uation. As the international environ- 
ment has become more complex, our 
deterrent strategy has become more 
flexible. Simultaneously, however, 
Soviet military strength, particularly 
nuclear capability, has increased 
much more rapidly than ours. This 
situation has heightened the debate 
about our ability, both real and 
perceived, to deter Soviet aggres- 
sion. 

Reviewing the evolution of our 
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deterrent strategy gives the impres- 
sion that changes in policy are more 
abrupt than they actually are. 
Changes in the strategic balance 
have been gradual, and we have rou- 
tinely altered our secret operational 
plans for actually using nuclear 
weapons should deterrence fail. 
Changes in our public deterrent stra- 
tegy, however, generally occur only 
after a new administration’s eval- 
uation of the strategic situation. The 
changes in deterrent strategy, and 
the catchy names associated with 
them, such as “massive retaliation” 
and “mutual assured destruction,” 
are actually landmarks along the 
same path, not changes in direction. 


Massive Retaliation 


America emerged from World War 
ll as the only nation with nuclear 
weapons. After the war, we demo- 
bilized most of our conventional 
forces, but the Soviet Union did not. 
Consequently, Soviet conventional 
forces became a major threat to 
postwar Western Europe. The limited 
number of atomic weapons available 
to the United States was not enough 
to prevent Soviet occupation of 
Western Europe. To contain Soviet 
expansion, therefore, we threatened 
atomic retaliation against the Soviet 
Union itself. 

The Soviet Union exploded its first 
atomic bomb in 1949, but superior 
bomber capability and an increasing 
stockpile of fission bombs gave the 
United States clear-cut nuclear supe- 
riority throughout the Truman Admin- 
istration. 

The Eisenhower Administration in- 
troduced the strategy known as 
“massive retaliation.” Henceforth, 
we would not match the larger Soviet 
conventional forces which threat- 
ened Western Europe. Instead, we 
would depend on nuclear weapons to 
prevent uncontrollable conventional 
aggression. Those weapons might 
be used not only on or near the field 
of battle but also against military 
forces and other installations in the 
enemy’s homeland. 

Massive retaliation presupposed 
our overwhelming nuclear superiori- 
ty. We could severely damage the So- 
viet Union while their threat to us 
was small. Although this strategy de- 
terred armed aggression throughout 
the Eisenhower Administration, in- 
creasing Soviet nuclear capability 
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Trident missiles are launched from nuclear-powered submarines like the one pictured 


here. 


PE canbe 


The Tomahawk is a low-flying cruise missile capable of seeking its target. 


had weakened the strategy’s credi- 
bility by the late 1950’s. 


Mutual Assured 
Destruction 


By the advent of the Kennedy Ad- 
ministration, the strategic nuclear 
balance had changed significantly. 
While the United States had more nu- 
clear weapons, both countries had 
large nuclear arsenals, including in- 
tercontinental ballistic missiles 
(ICBMs) placed in protective silos 
and, eventually, in submarines. 
These missiles, however, were not 
accurate enough to destroy the en- 
emy’s weapons, and it became clear 
that neither side could effectively 
reduce the other’s ability to retaliate. 
A nuclear war, therefore, would dev- 
astate both nations. 

The changing balance of nuclear 
Capability, therefore, prompted 
changes in our deterrent strategy. 


Without renouncing the first use of 
nuclear weapons in response to a 
conventional attack, we put less em- 
phasis on this aspect of strategy. If 
attacked, the United States said it 
would retaliate against both Soviet 
urban industrial and military targets. 
The basis for our approach to deter- 
rence, therefore, became the assured 
ability of both countries to destroy 
each other as national entities. This 
concept of mutual assured destruc- 
tion remains the last resort of our 
nuclear deterrent strategy. 

This strategy required that enough 
U.S. forces survive a nuclear attack 
to retaliate effectively. Mutual as- 
sured destruction, therefore, increas- 
ed the importance of numbers and 
size of nuclear weapons available to 
both countries, since this “balance 
of terror” also implied a balance of 
destructive capability. Any signifi- 
cant advantage in nuclear capability 
might affect, or be perceived as af- 
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fecting, this balance. 

Mutual assured destruction also 
prompted the development of three 
distinct elements in our nuclear 
forces. To preserve our retaliatory 
capability, we developed land-based 
ICBMs and sea-based, submarine- 
launched missiles to complement 
our strategic bomber force. These 
forces, known as the Triad, compel 
the Soviets to attack each element 
differently and to develop multiple 
methods of defense against them. 


Flexible Response 


Although our strategic capabilities 
improved throughout the 1960’s, the 
Soviets consistently spent more 
money on nuclear weapons than we. 
During the Vietnam War, Soviet stra- 
tegic nuclear capability increased 
until, by the early 1970’s, it equaled 
ours. The Soviet program empha- 
sized massive ICBMs, which could 
carry a large number of warheads. 
These ICBMs were placed in silos 
vulnerable only to a direct hit by a 
large nuclear warhead. 

The growing Soviet nuclear ca- 
pability seriously hampered U.S. ef- 
forts to deter conventional attack by 
threatening to use nuclear weapons. 
Since such retaliation might prove 
suicidal, our threat now seemed less 
believable. In Europe, the presence 
of many U.S. troops, and our reliance 
on tactical nuclear weapons to de- 
fend against numerically superior 
Warsaw Pact conventional forces, 
still maintained deterrence. Else- 
where, however, the threat was less 
persuasive. 

While nuclear parity did not sig- 
nificantly alter the reality of the ‘“‘bal- 
ance of terror,” it did create percep- 
tual problems. The Soviet buildup 
created a fear that, if faced with a 
full-scale nuclear war which we 
might lose, we might be susceptible 
to nuclear blackmail. For example, 
the Soviets might launch a limited at- 
tack against the United States or our 
forces abroad and still retain enough 
weapons to annihilate us, if we re- 
sponded. Such an attack, or its 
threat, could leave us with two 
choices: either a suicidal massive re- 
sponse or submission. The pos- 
sibility of nuclear escalation might 
even prevent us from using the tac- 
tical nuclear weapons needed to 
stop a conventional attack. 
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The B-1 bomber will drop both conventional and nuclear weapons. Pictured is the B-1A 
bomber. The Reagan Administration approved construction of the B-1B. 


To reinforce deterrence by remov- 
ing the Soviet temptation to consider 
any level of attack, the Nixon Admin- 
istration introduced the concept of 
flexible response. The massive 
retaliatory strike was divided into a 
series of smaller subsets that could, 
if necessary, be executed separately. 
The administration sought to show 
that we could deter attempted coer- 
cion or control escalation if deter- 
rence failed. To increase Soviet 
uncertainty about our precise 
capability and response, we did not 
define the nature and size of these 
options. 

At the same time, the United 
States introduced ‘essential 
equivalance” to enhance _ percep- 
tions of balance between the two 
countries. Essential equivalence 
compares the two nuclear forces in 


terms of megatonnage as well as 
such meaures as numbers of war- 
heads and delivery vehicles. The two 
forces are judged essentially equiv- 
alent if Soviet advantages in some 
areas are offset by U.S. advantages 
in other areas. 

Essential equivalence does not 
measure deterrent capability, but it 
does provide a way of judging rel- 
ative force size and capabilities. 
Because no one knows precisely 
what will deter the Soviet Union, 
essential equivalence, or its lack, 
cannot guarantee deterrence. But 
since we use essential equivalence 
to measure the strategic balance, it 
has acquired substantial political 
and perceptual significance. 
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Countervailing 
Strategy 


The Soviet nuclear buildup con- 
tinued throughout the 1970’s and in- 
cluded some disturbing new ele- 
ments. Soviet ICBMs, always the 
mainstay of their nuclear forces, 
began to feature multiple warheads 
whose improved accuracy might de- 
stroy our missiles in their silos. A 
single large Soviet ICBM with several 
warheads could destroy several of 
our missiles. As a result, for the first 
time in 20 years, one side might be 
able to limit the damage it would suf- 
fer in a retaliatory strike. An effective 
Soviet attack on our nuclear forces 
could again force a chcice between 
capitulation or suicide. 

Although the ability to launch 
such an attack does not imply a will- 
ingness to do so, dangerous percep- 
tual problems could result from this 
change in the nuclear balance. If the 
Soviet Union’s improved offensive 
and defensive capabilities have 
changed their perceptions of the out- 
come of a nuclear war, they may be 
less reluctant to risk it. If the United 
States seems intimidated by Soviet 
capabilities in a large-scale nuclear 
exchange, it will be increasingly dif- 
ficult to deal with Soviet superiority 
in conventional forces. And if our al- 
lies see us as less able or willing to 
effectively forestall or stop such ac- 
tions, their support may diminish, 
particularly when they are not direct- 
ly threatened. 

Responding to these perceptions, 
the Carter Administration further re- 
fined U.S. strategy to emphasize our 
willingness and ability to more flex- 
ibly employ nuclear forces to deter or 
respond to limited contingencies. 
While employment flexibility and 
responsiveness has been part of U.S. 
deterrent strategy since the Nixon 
Administration, it was more clearly 
defined with the emergence of 
“countervailing strategy” in 1979. 

Countervailing strategy requires 
that, in any contingency, the U.S. 
must be able to 

e absorb a limited attack and still 
respond in a controlled and de- 
liberate manner, 

e analyze quickly and correctly 
the nature of the attack and plan 
retaliation to eliminate any enemy 
advantage, 

e retaliate so that the enemy will 
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clearly see that it is a limited re- 
sponse, 

e retain the ability to hold vital 
and valuable targets hostage, while 
threatening their ultimate destruc- 
tion, to provide an incentive for 
escalation control, and 

e maintain forces at a high level 
of readiness, while trying to limit 
escalation and reduce tensions. 


According to countervailing strategy, 
we will deter coercion or attack at 
any level by being able to respond 
deliberately and selectively, thereby 
denying any enemy advantage. 

Unlike earlier approaches to flex- 
ibility, countervailing strategy does 
not rely solely on preplanned op- 
tions. This approach to deterrence 
implies the ability to rapidly modify 
existing plans to precisely fit the ex- 
isting situation. At the same time, we 
must be able to threaten valuable tar- 
gets as we press for escalation con- 
trol. To demonstrate this approach, 
the United States must have the 
planning ability and the weapons to 
provide an unbroken chain of military 
options from conventional war 
through full-scale nuclear war. 

The prospect of limited attacks, 
flexible responses, and attempts to 
control escalation have raised the 
spectre of limited nuclear war in the 
nuclear debate. Such a war has been 
discussed, particularly in Soviet mil- 
itary writing, for several years. Al- 
though the U.S. considered the con- 
cept of flexible nuclear response dur- 
ing the Kennedy Administration, only 
recent improvement in weapon capa- 
bility, particularly missile accuracy, 
has made it credible. Since the So- 
viets apparently accept this notion, 
we Can only try to deter it. 

Besides tailoring appropriate re- 
taliation, countervailing strategy 
also implies the ability to fight a pro- 
tracted but limited nuclear war, 
should deterrence fail. This war 
could involve one, or possibly sev- 
eral, limited nuclear exchanges pre- 
ceded and followed by weeks or 
months of high readiness, while we 
try to control escalation. Unless our 
forces prove they can wage such a 
war, an enemy may not be deterred 
from starting one. 

Although the Reagan Administra- 
tion does not refer to countervailing 
strategy, this approach has become 
part of its nuclear deterrent policy. 


Weapons Must Change 
To Match New 
Strategy 


Making our deterrent strategy 
believable will require translating our 
intentions into appropriate hard- 
ware. While the current administra- 
tion has been willing to pay the price 
of modernizing our forces, fiscal re- 
straints have made the Congress in- 
creasingly skeptical about whether 
we can afford new weapons sys- 
tems. In this environment it is es- 
sential that the weapons we do buy 
contribute as much as possible to 
our deterrent capability. 

Existing nuclear delivery systems 
were generally designed to meet the 
requirements of massive retaliation 
or mutual assured destruction. Em- 
ployment plans and system design 
presumed a massive exchange, us- 
ing most available weapons against 
a broad range of targets. In general, 
such retaliation was preplanned and 
available for execution based on a 
single precoded command. This type 
of “spasm” retaliation was the basis 
for planning, system characteristics, 
and the command and control sys- 
tem needed to operate these 
systems. 

From this perspective, the origin 
of a nuclear exchange hardly influ- 
enced its execution. And it was rel- 
atively easy to determine what kind 
of weapons you would need to fight 
it. Once started, the carefully pre- 
planned sequence of events would 
move to its irrational conclusion. The 
best guess of experts about what 
would happen was put into com- 
puters and translated into sterile, 
computerized exchange models. By 
juggling the capabilities and num- 
bers of various combinations of wea- 
pons, one could decide what, and 
how much of it, was necessary to win 
the war. If the Soviets were using the 
same computer program, they would 
theoretically be deterred from start- 
ing a war that our computer had 
already won. 

In August 1981, GAO published a 
report, ‘‘Countervailing Strategy 
Demands Revision of Strategic 
Force Acquisition Plans” (MASAD- 
81-35, Aug. 5, 1981), which explored 
the implications of current deterrent 
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Governmental Budget 
Reform: An Agenda for 


the Eighties 


Sixty years of evolution produced 
today’s Federal budget process. 
While the Budget and Accounting 
Act of 1921 established the notion of 
a coherent budget, submitted in uni- 
fied form by the executive branch, a 
series of discrete events altered the 
course of that evolution. In my view, 
the most important of these were 


e the adoption of the Brownlow 
Commission recommendations, 
which made the Budget Bureau, and 
thus the budget, a key instrument for 
presidential management; 


e the Employment Act of 1946, 
which established the legitimacy of 
using aggregate fiscal policy, and 
thus the budget, to promote eco- 
nomic stability and growth; 


e the adoption of the recommen- 
dations of the President’s Commis- 
sion on Budget Concepts, in 1967, 
which regularized what had previous- 
ly been an informal body of bud- 
getary conventions and practices; 
and 


e the Congressional Budget and 
Impoundment Control Act of 1974, 
which added institutions and pro- 
cedures to help the Congress act on 
budgetary aggregates and set fund- 
ing levels for broad categories of 
Government activity. 


The body of law and practice 
which has developed since the 1921 
act looks superficially impressive 
and sounds coherent, integrated, 
and comprehensive. One might even 
argue that no major national govern- 
ment possesses a better developed 
budget system. And taking into ac- 
count the inherent complexities re- 
sulting from a Federal system and 
the separation of powers, it seems 
even more impressive. 

Given this perception, one natural- 
ly asks why, today, should we dis- 
cuss ‘Governmental Budget Reform: 
An Agenda for the Eighties.” | offer 
several answers that are not mutual- 
ly exclusive. 


Why Do We Havea 
Problem? 


First, many people are displeased 
with what the system is producing 
right now. And different people are 
unhappy with different parts of the 
result for many different reasons. 
The conflict among the President, 
the Senate, and the House this year, 
a conflict centered on the budget, 
has almost paralyzed policymaking. 
And this near paralysis has occurred 
when the conflict between an expan- 
sive fiscal policy—embodied in the 
budget—and a restrictive monetary 
policy—embodied in the actions of 
an independent Federal Reserve Sys- 
tem—was yielding a recession ap- 
parently worse than any since the 
Great Depression of the 1930’s. Giv- 
en our history, this type of situation 
leads to reform of the system per- 
ceived as being part of the problem. 

Second, the Government and the 
Nation have changed dramatically 
since the basic elements of our cur- 
rent budget process were designed. 
Larger and more complex than in the 
1920’s, the Government requires a 
great many more decisions. Yet the 
number of formal decisionmakers (1 
President, 435 members of the 
House, and 100 Senators) has not 
changed materially, and the level of 
detail at which they attempt to oper- 
ate has changed little, if at all. In ad- 
dition, the breakdown of party and 
committee discipline now involves 
individuals who previously would not 
have made decisions. Rather than 
spreading the workload, their in- 
volvement only further complicates 
the process. The result is a system 
where decisionmakers are so inun- 
dated with details that they can 
scarcely focus on policy-level issues. 


Third, the political pressures on 
the budget process seem to have in- 
tensified in recent years. Despite 
growing dissatisfaction with the 
totals, the pressure to increase each 
of the parts has not declined. One 
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principal function of budgeting is to 
reconcile these conflicting pres- 
sures. But present congressional 
process requires a series of votes 
where the elected legislator must 
repeatedly, publicly, and explicitly 
choose between two unattractive al- 
ternatives. Voting to preserve a pro- 
gram means simultaneously voting 
to increase the deficit. The resulting 
frustration casts some doubt over 
the ability to preserve the process. 

Fourth, the economy—and our 
perceptions of how it functions— 
have changed in recent years. Events 
of the past decade, and particularly 
of the past year or so, have shown 
that an active fiscal policy (at least 
as it has been pursued) cannot yield 
generally satisfactory economic 
stability and growth. Today’s active 
and successful economic policy 
clearly requires effectively in- 
tegrating several different in- 
struments of economic policy. 

Finally, the systems which sup- 
port the budget process—systems 
for accounting, evaluation, and 
management information, partic- 
ularly—no longer meet its needs. Ob- 
solete designs have delayed their 
basic development, and insufficient 
integration has kept these systems 
from being mutually supportive. 
Some weaknesses concern only 
those who toil within the process 
itself. The hypothetical average 
citizen, if asked what was wrong with 
the Federal budget process, would 
probably say that the budget (or the 
deficit) was out of control and that 
something is wrong with a system 
where this can happen (or, at least, 
with the leaders who permit it). 

This “average citizen’s” concern 
about budget system results is prob- 
ably all we should expect. We, the 
presumed experts, ought to be able 
to figure out why it yields undesir- 
able results and how we can fix it. 

Suggestions abound, and we will 
be hearing much more about them in 
the coming years. By the end of this 
decade, the budget process will 
probably be considerably different. 


What Should We 
Expect of a Budget 
Process? 


Before considering differences, let 
us think about what the budget proc- 


GAO Review/ Fall 1982 


Governmental Budget Reform: An Agenda for the Eighties 


ess is and what it should ac- 
complish. 

Governmental budgeting is both a 
management and a political process. 
This “political” process involves 
more than partisan politics. Govern- 
mental budgeting is our cardinal 
process for reconciling an enormous 
number of divergent and often con- 
flicting policy objectives which we, 
as individuai citizens, seek to 
achieve through the instruments of 
government. 

Budgeting as a political process is 
(or should be) how we decide how 
much of the Nation’s resources will 
be used for which public purposes 
during a particular period. Such deci- 
sions have feedback effects. The 
present use of resources can affect 
(sometimes quite profoundly) the re- 
sources availabie for use, either now 
or later, by changing the aggregate 
level of economic activity. 

Besides fiscal policy, other factors 
affect the level of economic activity. 
Monetary policy clearly has com- 
parable power, at least in its ability 
to constrain the economy. And other 
components enter into an overall ec- 
onomic policy. Thus, with respect to 
economic stabilization and growth, 
the budget is (or should be) part of a 
much larger policy process. 

In addition to being a framework 
for policy formulation, the budget is 
(or should be) a management plan for 
the Federal Government. Here the 
budget should establish and rank the 
necessary tasks and the resources 
available for accomplishing them. 
The system which develops this 
management plan should also incor- 
porate (or connect with) mechanisms 
to (1) determine whether the tasks 
were carried out, and how well; (2) 
guide and control managers (when 
appropriate) to preclude excessive 
deviations from the plan or other im- 
portant policy objectives; and (3) hold 
managers broadly accountable for 
efficiently and effectively ac- 
complishing these assigned tasks. 


Simplification 


Some problems in the budget 
process result from these multiple 
roles and the difficulty of construc- 
ting decision points and information 
flows appropriate to each role. For 
example, the level of detail in the 
budget Appendix may suit the man- 


#@gement control function within the 
executive branch. But it fails as the 
framework for setting resource allo- 
cation priorities between the public 
and private sectors or within the pub- 
lic sector. 

No decisionmaker can grapple 
with the thousands of separate deci- 
sions represented by the appropria- 
tion account, activity, and object 
class structure in the Appendix. In 
trying to do so, even the most consci- 
entious decisionmaker would miss 
the forest for the trees. 

While decisions at this level of de- 
tail are important, those made at the 
top of the governmental structure 
must convert into more detailed deci- 
sions as one moves down the hierar- 
chy and simultaneously moves from 
planning broad priorities to im- 
plementing specific programs and 
activities. This downward movement 
quickly yields decisions at a much 
greater level of detail than is 
represented in the Appendix. But 
recognizing that the process /eads to 
highly detailed “managerial” deci- 
sions is quite different from assum- 
ing that those at the top need make 
those decisions. 

Public administration literature re- 
peats the notion that top policy of- 
ficials (the President and the Con- 
gress) should focus on board policy, 
including the basic direction and 
general content of programs. Ac- 
cording to this thesis, once these 
decisions are made, program man- 
agers should receive the authority 
needed to implement those policy di- 
rections and should be held respon- 
sible and accountable for the results. 
Although often endorsed but rarely 
implemented, this issue is taken 
more seriously today, partly because 
top policy officials simply have too 
many decisions to make. 

Thus, one necessary reform is sim- 
plification of the budget structure. 
This reform would reduce the num- 
ber of individual issues presented to 
the President and the Congress, 
while simultaneously elevating each 
decision’s importance. 


This simplification will not be 
easy. The first problem comes in de- 
ciding which decisions should be 
made at the top. Our constitutional 
system means the judgment must be 
reached by consensus, not by fiat. 
And controversies abound. 

The second problem comes in pro- 
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viding managerial discretion and, 


building effective accountability sys- 
tems at lower levels of the hierarchy, 
once the priorities have been set at 
the top. Government lacks the equiv- 
alent of business’s bottom-line prof- 
its, which limits discretion and mea- 
sures accountability. 

Good people have been struggling 
with these difficult problems for 
years. And while we may never ac- 
tually solve them, policy officials at 
the top of the pyramid are now pon- 
dering them. This level of attention 
should produce significant progress 
in the years ahead. 


Farsightedness 


Focusing on which policy issues 
are elevated to the top of the pyramid 
necessitates determining the con- 
text for their decision. The level of 
detail of the present budget process 
and the short-term emphasis of that 
process are mutually reinforcing 
pressures. Dealing with details 
means only worrying about the short 
run; concentrating on the short run 
means only affecting the details. 

Our present economic problems 
come from undue preoccupation 
with short-term consequences and 
inadequate attention to the longer 
term, where public policy decisions 
can have a much more substantial 
effect. The same is also true for other 
social policy objectives. For exam- 
ple, no policy instruments can cure 
centuries-old problems of discrimi- 
nation and poverty in a year or two. 
We should not expect them to do so, 
and we should not be so quick to as- 
sert failure when it takes longer than 
we thought. 

Let me clarify this crucial point. 
We cannot ignore the short run, such 
as the fact of a very large budget def- 
icit, the problem of 10 million people 
out of work, and the enormous cost 
to society (and the human tragedy) 
involved in poverty and discrimi- 
nation. But we should design our pol- 
icy process so that our policymakers 
can distinguish between what they 
can do in the short run (largely the 
amelioration of problems) and what 
requires longer term action. 

Admittedly, the dividing line be- 
tween the short run and the long run 
depends on the particular issue. 
Nonetheless, for those policy issues 
deserving congressional and presi- 
dential attention, the 1-year planning 


horizon of the traditional budget pro- 
cess is grossly inadequate. Econom- 
ic policy, for example, requires a 
planning horizon of 5 years or more. 
Our more pervasive social problems 
will probably require a generation to 
produce progress toward solutions. 

Appropriate planning horizons al- 
ready attract attention. Outyear bud- 
get projections have been a feature 
of the budget process for several 
years, and people have been looking 
at them with growing interest. Some 
of the most acrimonious debate on 
the budget this year has involved the 
deficit projections for 1984 and be- 
yond and what can (and should) be 
done to lower them. 


Proposals are being examined to 
shift the Federal Government to a bi- 
ennial budget. This shift would re- 
quire overcoming great resistance 
and solving many technical, pro- 
cedural, and policy problems. Some 
are obvious; others may not even ap- 
pear unless we make the shift. But if 
we do not make the switch con- 
sciously, we may find in a few years 
that we have largely accomplished it 
incrementally. This could happen 
through a steady expansion and ac- 
ceptance of such practices as multi- 
year contracting, multiyear funding, 
advance appropriations, etc. 

A growing desire to anticipate fu- 
ture conditions accompanies _in- 
creasing concern for the conse- 
quences of our policies. Originating 
partly in our failure to anticipate the 
energy crisis of the 1970’s, this in- 
terest has spread to other areas as 
well. 

A declining birthrate, an aging 
population, and an increasing per- 
centage of working women will have 
profound effects in decades to come. 
These factors, plus ongoing struc- 
tural changes throughout our eco- 
nomy and society, will create prob- 
lems and opportunities. No one can 
predict that future with confidence, 
but some evidence suggests that we 
are trying to anticipate conditions 
while time remains to rememdy 
them. 

Encouraged by this trend toward 
greater farsightedness, | attribute it 
to an increasingly realistic under- 
standing of our government, eco- 
nomy, and society. | believe that our 
political system is sufficiently flexi- 
ble and resilient to institutionalize 
the trend. 


Integration of Policies 


Some are beginning to understand 
that policies indeed interact and that 
we need to respond intelligently. Our 
economy is contracting in a severe 
recession despite the most expan- 
sive peacetime fiscal policy in his- 
tory. Many economists attribute this 
situation to the collision of that 
fiscal policy with a restrictive mon- 
etary policy designed to squeeze out 
the recent inflationary trends. 

Economists disagree about where 
the fault lies and thus about which 
policies should be changed. Indeed, 
some even hold that the problem is 
self-correcting and preach patience. 
But | suspect they are a declining 
minority. 

Senior officials increasingly recog- 
nize that both fiscal and monetary 
policy affect economic conditions. 
From the obvious collision between 
those two basic macroeconomic in- 
struments, officials will sense our 
need for an integrated policy. 

One cannot say how such integra- 
tion might occur because it has not 
yet received sufficient attention. One 
obvious choice would be to explicitly 
subordinate monetary authorities to 
the political process. But that prob- 
ably will not happen, given a strong 
tradition of an independent Federal 
Reserve Board and the useful insula- 
tion that formal independence pro- 
vides. 

During the next years, people will 
debate about how to maintain an in- 
dependent Federal reserve system 
while still assuring that its monetary 
policies are “tolerable” to the polit- 
ical system. As usual, we will find 
some pragmatic way of reconciling 
these apparently conflicting objec- 
tives. But further reform will mean 
considering the budget process as 
the mechanism for achieving neces- 
sary and desirable integration. 

The budget process will also in- 
tegrate other elements of economic 
and social policy. Through the years, 
but particularly in recent times, peo- 
ple have suggested regulatory, Fed- 
eral credit, capital, and tax expendi- 
tures budgets, to name a few. Cre- 
ating a true “budget” in any of these 
areas would require dealing with 
some very difficult (but not insur- 
mountable) conceptual and techni- 
cal issues. The results may or may 
not be worth the effort. But each pro- 
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posal evidences concern for the need 
to discipline a particular policy in- 
strument and to assure its effective 
integration with other policies. In the 
past, the “gold budget” incorporated 
into the budget process our concern 
over the balance of payments. These 
items illustrate the range of policies 
which may, in the future, be inte- 
grated through the budget process. 


Integration of 
Supporting Systems 


Integration involves not merely 
policies but, more important, the sys- 
tems which support their formula- 
tion. Officials do not (or should not) 
make policy in a vacuum. 

How people acquire this needed 
information constitutes part of the 
problem. The vast number of infor- 
mation systems and sources fre- 
quently work at cross-purposes. 
These include evaluation networks 
as well as systems for accounting, 
budgeting, management _ informa- 
tion, economic forecasting, program 
monitoring and reporting, auditing, 
and numerous other tasks. 

No policy official can make sense 
of it all because the design of each 
information source bespeaks isola- 
tion rather than integration. Each 
source has its own language, struc- 
ture, set of data elements, reporting 
frequency, and lag times. Thus, the 
decisionmaker must reconcile incon- 
sistencies and somehow understand 
everything. No wonder intelligent, 
conscientious officials simply de- 
spair. Inundated by data, they receive 
little real information. 

Reliance on one congenial infor- 
mation source only worsens the 
problem. By ignoring other potential 
sources of information, the decision- 
maker loses crucial parts of the pic- 
ture. And those who supply informa- 
tion are also at risk because budget 
austerity lulls people into cutting off 
seemingly irrelevant information 
sources. 

Aithough people have long com- 
plained about information overload, 
only now will we start to remedy it. 
As our ability to handle large vol- 
umes of data grows geometrically (in 
a technical sense), we can expect in- 
creasing integration of this data 
from multiple sources. This_ in- 
creased integration will entail com- 
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mon terminologies, common struc- 
tures of data, and common reporting 
intervals as a starting point. The 
eventual development of fully in- 
tegrated data bases will enable us to 
pull various facets of information 
about a program, for example, confi- 
dent that the data has both com- 
monality and integrity. 

If simplification occurs along 
these lines, the budget will probably 
provide both the pressure and the 
framework for this integration. Infor- 
mation systems which cannot be in- 
corporated within this unifying deci- 
sion framework will become increas- 
ingly isolated and irrelevant in the 
real world. 


Balanced Budget 
Amendment 


Returning to budget policy mat- 
ters, | think the issue of a constitu- 
tional amendment requiring a bal- 
anced budget fits into a different 
category of “reforms.” 


My ideas for reform have focused 
on helping policy officials decide 
what policy objectives to pursue and 
how to pursue them. These reforms 
presume that, given good data, good 
analysis, and an appropriate deci- 
sion framework, policy officials will 
choose appropriate policy objectives 
and pursue them effectively. Hence, 
these “reforms” concentrate on the 
policy formulation system rather 
than the policies themselves. 

The balanced budget amendment 
starts from a different premise. Ac- 
cording to this position, our political 
system is inherently biased and, 
thus, we cannot trust it to yield a 
specific outcome. Consequently, 
only a constitutional mandate can 
force it to work the way we want it. 

Without presuming to urge accep- 
tance or rejection of this proposal, | 
will examine some difficult technical 
issues in making the approach work. 
Definition provides a problem. Those 
who struggle with the budget dispute 
how to draw a line around the govern- 
ment, that is, what should be in the 
budget and what should not. Like the 
concept of the “entity” in account- 
ing, the issue is conceptually very 
simple but operationally very com- 
plex. Faced with many gray areas, 
we have.produced a series of conven- 
tions to define government for budg- 


eting purposes. And these conven- 
tions have changed from time to 
time. 


The proposed amendment no- 
where reflects these conventions or 
their mutability. While some might 
welcome flexibility in a potentially 
unduly rigid constraint, the citizens 
may balk if they ratify a constitu- 
tional constraint, only to see it easily 
defined away. 


Suppose, for example, that the 
Congress and the President were to 
enact a law stating that, for budg- 
etary purposes, the Social Security 
trust funds are no longer part of the 
Federal Government. Such proposal 
has recently been revived, and there 
is precedent for it, since the funds 
were outside the budget before 1967. 
If not rejected by the Supreme Court, 
that step, and others like it, could ef- 
fectively nullify the amendment. 


A second set of problems con- 
cerns feasibility. We all recognize 
our Government’s problems in reduc- 
ing the 1983 deficit to $100 billion. 
Every proposal to do so combines 
spending cuts and revenue increases 
(or “enhancements,” to use the cur- 
rent euphemism). Imagine the diffi- 
culty of bringing the deficit to zero, 
and doing so without any increase in 
taxes. Admittedly, the amendment 
calls for reaching this goal over a 
period of several years. But given the 
structure of tax cuts already en- 
acted, that may make the objective 
even more difficult. Indexation of tax 
brackets neutralizes the effect of in- 
flation on revenues without relieving 
the pressure of inflation on expen- 
ditures. 


From another perspective, one 
wonders how we would handle the in- 
herent imprecision of the economic 
statistics which would define the 
constitutional constraint. Nor can we 
foresee how the implementing rules 
(particularly those dealing with en- 
forcement of the mandate) would af- 
fect the historic balance among the 
branches of government. 


These questions alone—and there 
are others—convince me that we 
would be in for some troublesome 
times if the amendment were passed 
and ratified. 
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Safety (n.): 





Security (n.): Measures taken to guard against espionage or 
sabotage, crime, attack, or escape 


The condition of being safe from undergoing or caus- 
ing hurt, injury, or loss 








Many of you who have been in 
GAO during the past 18 months have 
seen and been a part of the many 
changes in GAO’s security program. 
This program, which has expanded 
greatly in scope and quality, is help- 
ing to improve almost every phase of 
work life at GAO. In this article, we’d 
like to review GAO’s security history 
and show how our agency has be- 
come safer and more secure. 


History 


GAO’s expanded emphasis on 
safety and security began in 1979, 
when former Comptroller General 
Elmer Staats was advised that GAO 
had the second highest crime rate of 
any government building in the 
Washington, D.C., area. To com- 
pound the problem, Mr. Staats was 
also informed that hostile intel- 
ligence operatives may have been 
trying to use GAO as an information- 
gathering source.! 

In June 1979, Mr. Staats met with 
William Webster, Director of the FBI, 
to discuss GAO’s crime and security 
problems. At Mr. Staats’ request, a 
team of FBI agents surveyed GAO. 
The FBI’s findings, issued as a 
classified report in September 1979, 
showed an overall need for improve- 
ment in GAO’s security measures. 

After reading the FBI’s report, Mr. 
Staats organized the GAO Security 
Task Force to examine a broader 
range of GAO activities. The task 
force reviewed technical, personnel, 
and document security practices and 
procedures throughout GAO and its 
regional offices. The task force rec- 
ommended that an Office of Security 
be established to incorporate the 
Safety and Security Branch from the 
Office of Administrative Services 
and assume responsibility for per- 


sonnel security, a matter then han- 
died by the Personnel Office. 

On November 5, 1980, Arthur Klek- 
ner was appointed as the first di- 
rector of the new Office of Security, 
which was charged with 

e establishing policy, standards, 
and procedures to ensure a safe 
working environment for GAO em- 
ployees; 

e protecting property and material 
entrusted to GAO; 

e safeguarding sensitive informa- 
tion from unauthorized disclosure, 
espionage, or sabotage; 

e administering the personnel se- 
curity program with regard to grant- 
ing security clearances and employ- 


ment suitability; and 

© conducting investigations and 
inspections to ensure GAO-wide 
compliance with security and safety 
policy. 


In December 1981, the office was 
renamed the Office of Security and 
Safety (OSS) to more closely reflect 
its mission. OSS’ actions to expand 
GAO’s security program have been 
based largely on task force recom- 
mendations, recommendations of its 
new director, and guidance from the 
Comptroller General’s office. 





‘After this article was written, the Senate 
Special Committe on Intelligence reported 
that investigations had found no information 
to support allegations that foreign agents 
were able to obtain classified documents 
from GAO because of lax security proce- 
dures. Between 1979 and 1982, the Federal 
Bureau of Investigation and the committee 
staff reviewed security and document con- 
trol at GAO. A summary report appeared in 
the September 24, 1982, Congressional 
Record, pp. $12286-87 and the October 5, 
1982; issue of the GAO Management News. 
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Limiting Access Is a 
Priority 


After reviewing the task force’s 
recommendations, OSS set its pri- 
orities and began to take action. 

OSS first explored the problem of 
unauthorized entry into the GAO 
Building. Until this time, the building 
was considered “open,” and mem- 
bers of the public had reiatively free 
access to it. OSS’ priority was to re- 
vamp the procedures which allowed 
an individual to enter the GAO 
Building. To tighten security, the 
General Services Administration, at 
the request of OSS, declared the 
GAO Building “closed,” and access 
by the public and other visitors is 
now more tightly controlled. Turn- 
stiles have been installed at the G 
and H Street entrances and can be 
operated only with magnetically en- 
coded identification cards. All other 
visitors must be identified and 
checked in by the contract guard 
force, which is under Federal Protec- 
tive Service jurisdiction, or by the 
GAO receptionists (OSS employees) 
who are located at the G Street en- 
trance. Sensitive locations within the 
building, such as the Procurement, 
Logistics and Readiness Division, 
the Mission Analysis and Systems 
Acquisition Division, and the GAO 
Mailroom, are equipped with their 
own access control readers to pre- 
vent access by unauthorized person- 
nel. 

In conjunction with the building 
access control system, barriers have 
been installed between the first floor 
and basement stairwells to thwart 
property theft. (The barriers open dur- 
ing emergencies.) Also, closed-cir- 
cuit cameras have been installed to 
monitor activity in selected interior 
and exterior locations. 

GAO’s Office of Administrative 
and Publishing Services (OAPS) and 
the General Services Administration 
(GSA) spent many hours overseeing 
the installation of turnstiles, stair- 
well barriers, and the reception 
desks at GAO entrances. Without 
their dedicated efforts, none of this 
equipment could have been _ in- 
stalled. 

Along with magnetic identification 
cards, new credentials were issued 
to GAO’s audit, evaluation, and in- 
vestigative staff and to high-level 
GAO officials. The credential, used 
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primarily to identify GAO employees 
to other government or private-sector 
agencies, delegates the authority of 
the Comptroller General to inspect 
the records of another organization. 
GAO’s nonaudit employees do not 
need a credential to perform their 
work and use the new magnetic card 
as GAO identification. 

GAO’s reports present another se- 
curity problem. The public must have 
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access to the Document Distribution 
Center on the first floor to pick up 
copies of reports. A new distribution 
area, located just inside the H Street 
entrance, allows individuals to ob- 
tain reports without going through 
check-in procedures, but they are not 
allowed further access into the build- 
ing. Restricted or classified reports 
are not distributed to the public. 


The Federal Protective Service, which provides the guard force for GAO, used a manual 
check-in procedure for visitors before the turnstiles were installed. 


GAO receptionists Linda Ciancio (i.) and Beth Raffensperger greet visitors at the G 
Street entrance and quickly validate approval for entry via computers. 
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Stairwells between the first floor and basement are equipped with barriers. 


Safeguarding from 
Espionage 


GAO is responsible for the 
safekeeping and security of sensitive 
and classified material obtained in 
the course of an audit. During the 
past several months, all GAO activ- 
ities have been undergoing a com- 
plete inventory of their classified 
documents. 

To strengthen GAO’s safeguard- 
ing ability, the agency is negotiating 
with the Department of Defense to 
participate in their Industrial Securi- 
ty Program. This program assures 
the safe handling of classified infor- 
mation when it is being used by U.S. 
industrial organizations, educational 
institutions, and any subcontractors 
or facilities used by contractors. 
When a contractor takes classified 
material off Government premises, 
the contractor’s personnel, storage 
facilities, and handling procedures 
must be adequate to protect the ma- 
terial. (In GAO’s case, this program 
will particularly apply to our con- 
sultants.) Defense’s Industrial Se- 
curity Program has employees na- 
tionwide who investigate, grant 
clearances to, and monitor the se- 
curity procedures of contractors and 
consultants when these steps are re- 
quested by the user agency. 

Also, to reinforce the idea that se- 
curity can be compromised at any 


time or at any place, OSS scheduled 
security briefings and seminars to 
advise GAO employees of the poten- 
tial threat by hostile intelligence ef- 
forts. In the past year, the Federal 
Bureau of Investigation has provided 
secret-level briefings to GAO man- 
agement. The briefings concentrated 
on the counterintelligence threat by 
using case histories and illustrating 
methods of operation, telecommun- 
ication interception, and means of 
recruitment. These briefings gave 
guidance on reporting such activities 
so that the FBI can monitor suspi- 
cious personnel. The FBI will also be 


briefing GAO’s regional offices in the 
near future. 

The FBI was also requested to 
take a second look at GAO’s security 
program. During the fall of 1982, an 
FBI inspection team will be review- 
ing the accomplishments to date to 
reduce the threat of potential hostile 
elements. 

In the personnel security area, 
GAO Order 0920.1, “The Personnel 
Security Program of the General Ac- 
counting Office,” is being revised to 
better identify all GAO positions and 
categorize them according to sensi- 
tivity. This will allow OSS to better 
determine what type of background 
investigation is needed for each po- 
sition. The revised order will also 
establish policy and procedures to 
process and adjudicate matters re- 
garding security clearances and 
suitability for employment. The proc- 
essing time for GAO security clear- 
ances, formerly 75-120 days, has 
lessened considerably; it now takes 
an average of 30 days to obtain an in- 
terim clearance. Indications are that 
the time may decrease further. 

GAO is also stepping up action 
against electronic surveillance. The 
agency now possesses equipment 
that can locate “bugs” in offices and 
in telephones. OSS has also distrib- 
uted telephone stickers reminding 
employees that GAO telephones 
should not be used for classified 
conversations. Sometime during the 
early fall of 1982, a secure telephone 
will be installed in the office area of 
the Mission Analysis and Systems 
Acquisition Division. 
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New and Revised GAO Orders on Security and Safety 


“Smoking and Non-Smoking in GAO-Occupied Space” 
“Physical Security Procedures for All GAO Activities” 
“Identification Media” 

“The Personnel Security Program of the General Ac- 


“Information Security Program” 
“NATO Information Security” 
“Safeguarding Unclassified Sensitive Proprietary Infor- 


“Occupant Emergency Plan” 
“Fire Prevention and Protection Practices” 
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General Services and Controller director Richard Brown (center) discusses the new 
turnstiles with (from left) Mallory Andrews, deputy director, OAPS; Carolyn May, 
Facilities Branch manager, OAPS; Arthur Klekner, director, OSS; and Carmelo Ciancio, 
Space Management section chief, OAPS. GSA was also instrumental in getting securi- 


ty equipment installed. 


Employee Safety 


Ensuring the safety of employees 
is one of OSS’ biggest concerns. Ac- 
cess to the GAO Building has been 
limited, but this does not eliminate 
all the problems. Should a medical or 
safety emergency occur, OSS has 
implemented a building-wide HELP- 
line to bring immediate assistance. 
The number, 275-HELP, rings sim- 
ultaneously in OSS and at the guard 
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desk, but it should be used only in 
cases of medical emergencies, sus- 
pected fires, or when an employee 
needs emergency help. Non-emer- 
gency, routine calls and reports 
should be directed to OSS’ main 
number, 275-4700. 

Alarmed over a recent rash of mug- 
gings of GAO employees leaving the 
building later than normal working 
hours, OSS has organized an after- 
hours shuttle service. The shuttle 
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leaves the G Street building entrance 
every 15 minutes between 6:00 - 10:00 
p.m. and takes employees to neigh- 
boring parking lots and the Judiciary 
Square subway station. 

OSS, having the responsibility for 
GAO’s parking program, was recent- 
ly able to acquire 100 additional 
building parking spaces from GSA. 
As a result, nearly all GAO employ- 


Assistant Comptroller General John 
Heller is approved to enter the parking 
area under the GAO Building. 


ees who had requested a parking 
space in the building were able to 
receive one. (Carpools still receive 
priority for available spaces.) By ob- 
taining more indoor parking, OSS 
hopes to provide a safer environment 
for employees who drive to work. 

OSS is also conducting after- 
hours security and safety inspec- 
tions. These inspections will reveal 
any weaknesses in storing and han- 
dling classified material and will 
identify those offices that have the 
potential for theft (personal and Gov- 
ernment property left unsecured). 

A safety and security program is 
only as good as the participants 
make it. Because the GAO Building 
is occupied by several agencies, OSS 
saw the need for coordinating the 
safety and security functions among 
the agencies. The GAO Building 
Physical Security Board, comprised 
of representatives from each tenant 
agency, meets periodically to con- 
sider internal safety and security 
matters. To ensure that each new 
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employee is aware of security and 
safety matters, a new employee 
receives a security briefing when 
joining GAO, and periodic update 
briefings will soon be implemented. 
A termination briefing is given when 
an employee leaves the agency. In 
addition, employees traveling over- 
seas, whether for personal or bus- 
iness reasons, will receive a special 
briefing package before leaving the 
country, if such travel is made known 
to OSS. 


Future Steps 


In the 2 years following approval of 
the GAO Security Task Force’s rec- 
ommendations, GAO has developed 
an excellent security organization 
staffed by competent, enthusiastic 
security professionals. The_ in- 
creased emphasis on safety and se- 
curity has already shown results. In 
the first 6 months of 1979, reported 
incidents of criminal activity in the 
GAO Building numbered 222. In 1982, 
the 6-month figure had dropped to 
32. Even though much has been ac- 
complished by the new Office of Se- 
curity and Safety, much remains to 
be done. 

In the future, OSS is considering 
changing the elevator schedule so 
that only one G Street elevator will 
operate to the basement during se- 
curity hours. Individuals in the 
building would have to change ele- 
vators at the G Street pedestrian 


area where the night guard is lo- 


cated. This will help restrict thefts of 
Government and personal property. 
Also, OSS will install access control 
readers in the basement and sub- 
basement elevator lobbies. This will 
eliminate the need for guards to 
check individual identification cards 
for those entering the building by 
vehicle and will reduce the traffic 
backups that result. Still, only au- 
thorized employees using a mag- 
netic identification card would be 
able to enter the building from these 
areas. 

The Investigations and Compli- 
ance Branch, OSS’ most recent addi- 
tion, is presently developing a GAO- 
wide security and safety compliance 
program which will help ensure that 
GAO employees have a safe and 
healthful work environment. As part 
of this program, OSS will develop the 
Security and Safety Compliance In- 


Comptroller General Bowsher (I.) and Arthur Klekner, director of OSS (2nd from 1.), 
discuss GAO’s new turnstile system with John Jester (2nd from r.) and Randy Lash, 
representatives of the Federal Protective Service. 


specton Guide, which will include an 
introduction to five security and safe- 
ty areas and a series of easy-to-use 
inspection checklists. This guide will 
provide managers with a single ready 
reference by which they may review 
their operations, with emphasis on 
information security, physical securi- 
ty, personnel security, occupational 
safety and health, and crime preven- 
tion. The guide may also be used to 
review the security and safety pro- 
cedures of the regional offices and 
to orient new employees in safety 
and security procedures. The branch 
is also responsible for establishing 
an internal investigation program 
within GAO. This program will ad- 
dress the prevention or detection and 
certain investigations of alleged 
criminal violations in which agency 
employees may be either victims or 
perpetrators. 

OSS is also developing an In- 
dustrial Hygiene Compliance Pro- 
gram. This program, incorporating a 
new OSS Safety Laboratory, will 
oversee samples and tests for air- 
borne asbestos, chemical hazards in 
the printing plant, abnormal sound 
and radiation levels, and other condi- 
tions which might endanger employ- 
ee health. 


In a recent letter to the Senate 
Committee on Governmental Affairs 
on GAO’s security system, Comp- 


Comptroller General Bowsher cuts the 
ribbon to open GAO’s security turnstiles 
at the G Street entrance. 


troller General Bowsher stated, “... 
GAO will have a security program 
which is thoroughly up-to-date and 
among the very best in the Washing- 
ton area.’”’ With the cooperation of 
each GAO employee, we can achieve 
this goal. 


GAO Review/Fall 1982 





Robert B. Garey 


Mr. Garey is a policy analyst in the Labor and 
Policy Studies unit of Oak Ridge Associated 
Universities of Tennessee. He has a B.S. in 
mathematics and a Ph.D. in political science, 
with concentration in public administration 
and policy, from the University of South 
Carolina. His current areas of interest in- 
clude program evaluation, nuclear waste pol- 
icy, labor market analysis, and R&D funding 
decisions. 


John F. Sacco 


Mr. Sacco is an associate professor of public 
administration at George Mason University in 
Fairfax, Virginia. Prior to his teaching posi- 
tion, Mr. Sacco was with the Office of Evalua- 
tion at the Department of Housing and Urban 
Development. Mr. Sacco holds a Ph.D. in 
public administration from Penn State Uni- 
versity, a master’s degree in public ad- 
ministration from New York University, and a 
B.A. from Penn State. He is a member of the 
American Society for Public Administration. 


GAO Review/Fall 1982 


Everyday Bureaucratic 
Realities and Program 
Evaluation 


Editor’s Note: From time to time the 
GAO Review publishes articles 
which, while not directly related to 
GAO evaluation activities, provide in- 
sight and suggest approaches useful 
in our work. This article provides in- 
sight into the problems faced by in- 
ternal evaluators and offers solu- 
tions they have found useful. Of 
course, not all these solutions are 
available to GAO evaluators, but 
many, with appropriate modifica- 
tions, can be of interest to our staff. 
GAO has compiled the results of 
agencies’ internal evaluation work in 
a sourcebook entitled Federal Eval- 
uations: A Directory Compiled by the 
Comptroller General, 1981 Congres- 
sional Sourcebook Series, (PAD- 
82-9). Copies can be obtained in 
Room 1518 of the GAO Building; call 
(202) 275-6241. 


Government agencies, to a much 
greater extent than in the past, are 
conducting many of their own evalu- 
ations. Part of the reason for the 
growth of internal evaluations re- 
sults from mandates in enabling leg- 
islation; part results from the de- 
mand of policymakers and managers 
to have better information on pro- 
gram performance. Questions cov- 
ered in the internal evaluations range 
widely, including the speed at which 
programs are implemented and com- 
pleted, the degree to which programs 
reach targeted populations, the 
gains realized by the people served, 
and the appropriateness of activities 
selected. This article focuses on in- 
ternal evaluations and the practical 
problems associated with conduc- 
ting these evaluations. 

One of the most critical features of 
conducting internal evaluations is 
being able to deal with the day-to-day 
realities of bureaucracy. Failure to 
do so means that evaluations will not 
get off the drawing board, they will 
falter along the way, or they will end 
up sitting on the shelf. Unfortunately, 
most of the literature on doing evalu- 
ations focuses on the technology 


and rational methodology of evalua- 
tion. While these are important, they 
rarely help the analyst in moving 
through the human and social com- 
plex of organizations. This means 
that, in addition to knowing what 
technology is best to deal with such 
problems as regression artifacts, 
halo effects, or autocorrelation, the 
analyst inside a bureaucracy needs 
to know how to handle other con- 
straints, including decision dead- 
lines, hidden data bases, distant and 
busy policymakers, and organiza- 
tional sabotage. This article shows 
how knowledge of bureaucratic 
agencies, combined with formal 
evaluation techniques, can help in 
dealing with these organizational 
constraints and, further, shows how 
this combination can produce better 
and more timely evaluations. 


Bureaucratic Realities 


There are four major bureaucratic 
realities that confront evaluators: 


e Organizations have deadlines 
and short time horizons for meeting 
these deadlines; evaluation research 
takes time. 

e Policy issues are often clouded 
and vague; evaluation needs clear 
direction. 

e Organizations either have their 
data hidden or buried, or do not have 
it at all; evaluators need data and 
ready access to it. 

e Organizational members do not 
always practice openness and coop- 
eration; evaluators need both to con- 
duct investigations. 


Deadlines 


The deadline is probably the most 
pervasive yet least addressed prob- 
lem of conducting evaluation in bu- 
reaucratic organizations. To be use- 
ful to policymakers, evaluations 
must produce information and re- 
sults by a designated time. Delivered 
late, the results are of little or no 
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value. Congressional committees do 
not wait for a study to be refined 
when budgets are being decided; 
State legislators do not pause for the 
elegance of a multiple regression 
when they are being pressed to pass 
a piece of legislation; city councils 
do not delay decisions on such mat- 
ters as service delivery until a citizen 
survey has been completed. As Wil- 
liams’ emphasizes, “(t)o the extent 
that the use of outcome data, par- 
ticularly the results of major program 
evaluations, are accepted by major 
decision makers, they want the data 
‘as of yesterday’.” 


Staying Abreast Of and 
Clarifying Policy Issues 


If the deadline were the sole im- 
pediment facing the evaluation proc- 
ess, the task of evaluation would still 
be reasonable. Such is not the case, 
however. Coupled with deadlines is 
the problem of determining the na- 
ture of the issue. Often, evaluators 
do not know enough about the policy 
issues, or they are unable to gain an 
understanding of the issue in enough 
time to act swiftly. 

For a variety of reasons, issues 
rarely reach the evaluator quickly or 
clearly. Part of the difficulty is the 
organizational distance between the 
evaluator and the people in charge of 
operating programs. In many _in- 
stances, evaluators are isolated or- 
ganizationally from the program of- 
fice. Because of this separation, the 
analysts do not receive firsthand in- 
formation on the issue. Either the an- 
alyst must wait until a formal request 
is made or rely upon informal con- 
tacts for information. 

This filter-through process, poor 
as it is, represents only a part of the 
communication problems facing the 
evaluator. Frequently, the evaluator 
is either left unaware that a problem 
exists, or worse, is sent off in the 
wrong direction by policymakers or 
Program managers. Simply put, infor- 
mation is not easily or readily shared 
in bureaucracies. Either through ac- 
cident or intent, the sharing process 
falters. Program managers are not 
necessarily willing to let others—es- 
pecially evaluators—in on the trials 
of the program because they fear 
what the findings of ‘no effect” 
could mean ,for continued funding 
and support. Messages transferred 
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between evaluators and persons lo- 
cated elsewhere in the organiza- 
tional structure become garbled, 
even when the senders have good in- 
tentions. This occurs because in- 
dividuals in a bureaucracy pursue 
different goals, face different deci- 
sions, have different interests to pro- 
tect, and sometimes,think and talk in 
different languages. 

Evaluators, too, do not help mat- 
ters in getting issues clarified. Ana- 
lysts are inclined to pose issues in 
terms of the relationships between 
variables. Characteristically, the 
evaluator frames questions in a mea- 
surable way: Is age related to suc- 
cess in training? Is concentrated 
housing rehabilitation related to 
neighborhood revitalization? Policy- 
makers, in contrast, want to know 
generalities, such as how to get 
young people into jobs and how to 
save neighborhoods. Obviously, the 
two parties, while focusing on the 
same area, are using different lan- 
guages. The result, all too often, is 
frustration for both parties. 

A related source of friction is that 
policymakers, who are the most in- 
terested in the content and decision- 
relevance of evaluation studies, view 
evaluators as preoccupied with 
“issues of validity.”4 To policy- 
makers who must make time-critical 
programmatic decisions based on 
several sources of incomplete in- 
formation (of which evaluation re- 
sults are one), validity issues are 
considered weak ones. Evaluators, 
on the other hand, are concerned 
that their substantive findings will be 
challenged because of a poor re- 
search design5 or that unwarranted 
conclusions will lead to inappro- 
priate program decisions. 


Hidden Data 


Next in the line of barriers facing 
evaluation is the data problem. Rare- 
ly can evaluators sit at a computer 
terminal, gain quick access to se- 
lected data, and print out the needed 
information. Data files are much 
more difficult to obtain, organize, 
and gain access to in bureaucracies. 
To begin with, the data or their loca- 
tions are often in the heads of the bu- 
reaucrats rather than listed in tidy 
codebooks. Without knowing who 
these key people are, the evaluator is 
at a loss. 


It is not uncommon, for example, 
for one person to be in charge of 
large paper files which are organized 
for accounting rather than policy pur- 
poses. In these cases, retrieving and 
searching these records depends on 
the willingness of that person to co- 
operate with a request that deviates 
from the routine of the day and is 
probably considered of questionable 
value. 

Even in those cases where the 
data are automated, quick access is 
not guaranteed. The data may need 
to wait in queue before being run, the 
software necessary to manipulate 
the data may not be written, or the 
cost of extracting the data may be 
very high. All this consumes time, 
and time is what the evaluator does 
not have. 


Bureaucratic Resistance 


Most of the deterrents noted thus 
far are caused by the size and com- 
plexity of organizations; however, the 
frustration of evaluation goes be- 
yond circumstances resulting from 
those factors. In some instances, the 
obstructions are the product of con- 
scious interference. Such road- 
blocks can come at any and all 
points in the evaluation process. 
They may enter at the outset of the 
process in the form of harboring 
data, or they may appear at the end 
as vetoes over reports. Wherever 
they occur, these are problems the 
evaluator must successfully over- 
come. 





‘Walter Williams, Socia/ Policy Research 
and Analysis (New York: American Elsevier 
Publishing Co., 1971). 

@Rheka Agarwala-Rogers, ‘Why Is Evalua- 
tion Research Not Utilized?’’, in Evaluation 
Studies Review Annual, Vol. 2, ed. M. Gutten- 
tag (Beverly Hills, CA: Sage Publications, 
1977). 

3Martin Rein and Sheldon White, ‘Can 
Policy Research Help Policy?’’, in Evaluation 
Studies Review Annual, Vol. 3, ed. T. Cook 
(Beverly Hills, CA: Sage Publications, 1978). 

4Gary B. Cox, ‘‘Managerial Style: Implica- 
tions for Utilization of Program Evaluation,”’ 
Evaluation Quarterly, 1, pp. 499-508. 

5Carol Weiss, ‘The Politization of Evalua- 
tion Research,”’ in Cases in Public Policy- 
Making, ed. J.E. Anderson (New York: 
Praeger Publishers, 1976). 
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Strategies for Dealing 
with Bureaucratic 
Realities 


The strategy for dealing with these 
bureaucratic realities relies on com- 
bining the techniques of rational, 
data-based evaluation methods with 
an understanding of the host organi- 
zation and a knowledge of how to 
use the organization’s resources. At 
the core of this strategy is the reali- 
zation that neither methodology nor 
organizational knowledge is suffi- 
cient for in-house evaluation. While 
the technical components of evalua- 
tion are important to the veracity of 
analysis, they provide only half of the 
input. To apply these techniques ef- 
fectively, the evaluator must learn 
the organizational system and culti- 
vate the skills for gaining coop- 
eration or assistance from the organ- 
ization. In short, the evaluator needs 
two educations: one directed at tech- 
niques, which includes sampling, re- 
search design, measurement, statis- 
tical analysis, etc., and the other 
directed at the host bureaucracy, 
which includes knowing who has 
program information, who collects 
data on the programs, who can iden- 
tify critical policy issues, who is 
interested in analysis, and who has 
leverage in getting policymakers to 
consider evaluation results. When 
these tools are used together, quick 
and usable evaluation can be 
produced. 


Dealing With Deadlines 


The combination of evaluation 
technology and organizational 
knowledge is clearly essential in ad- 
dressing the first bureaucratic con- 
straint, the time deadline. With a 
knowledge of the inner workings of 
the agency, the evaluator has a 
sense of which data and information 
can be easily and readily obtained. 
With such an array at hand, the eval- 
uator can save valuable time by not 
attempting to secure information 
that may be theoretically worthwhile 
but not readily accessible. For exam- 
ple, in evaluating a job training pro- 
gram, completion rates may be avail- 
able, but there may be little or no in- 
formation on the extent to which 
completers gained marketable skills. 
While information on skills learned is 
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preferable to knowing only whether a 
person completed the program, ef- 
forts to secure such data might be 
out of the question given the 
deadline. 

In the cases where there is a seri- 
ous question about pursuing only the 
more accessible data, knowing the 
organization can again help the eval- 
uator decide if the effort and risk re- 
quired to collect the less readily 
available data are advisable. In par- 
ticular, knowing the type of decision 
for which the data are needed can 
help determine what type of data to 
pursue. If the results are to be used 
in making a modest program deci- 
sion, then the data requirements 
might be less stringent than if the 
decision were a major one. 

While knowledge of the organiza- 
tion can help identify which informa- 
tion is available, sound research 
techniques may be needed to collect 
the data. Certain research tech- 
niques provide ways of locating use- 
ful data within the time allotted. One 
technique is judgmentally selecting 
a few large locations and using ran- 
dom sampling at these sites. This 
technique permits the evaluator to 
obtain a representative picture of the 
program at those locations while not 
consuming exorbitant resources in 
collecting the data. For example, the 
units selected might be entire train- 
ing centers or whole housing com- 
plexes instead of individuals more 
widely dispersed. With such a sam- 
ple design, several respondents can 
be interviewed at one time and place, 
thus speeding up data collection. 


Another way of employing 
research techniques is through the 
careful use of surrogate measures. 
For instance, if a readily available 
measure of a problem appears to cor- 
relate highly with less available 
measures, then the most accessible 
measure among them can be used 
without additional data collection. 
Examples of useful surrogates are 
turnover rates for employment dis- 
satisfaction and completion rates for 
skill development. These are crude 
measures, but they can capture or 
explain behavior or outcomes in 
selected situations. 

Quasi-experimental and experi- 
mental designs can also aid in 
meeting deadlines. In these designs, 
the evaluator has some control over 
program introduction and variation. 


For example, the evaluator might be 
able to take a program and randomly 
initiate it over time, first placing it in 
a few areas, then in more areas. In 
this way, the evaluator ensures quick 
feedback and a good design for as- 
sessing effect. (This, of course, is a 
luxury that internal evaluators may 
enjoy that outside evaluators may 
not.) 


Dealing With Issues 


Organizational knowledge and re- 
search technology can also be used 
to clarify policy issues. These range 
from using organizational skills in 
locating individuals with important 
policy insights to using research 
skills for such traditional tasks as 
conducting background literature 
searches. 

Students of organizations suggest 
that one route to understanding the 
issues is through face-to-face 
meetings with policymakers and pro- 
gram managers. These are the peo- 
ple who make the decisions and are 
most likely to have a sense of the 
origin or reason for the issues. Also, 
for these people, the face-to-face ap- 
proach is appropriate since they are 
comfortable with personal communi- 
cation. It is their forte, and it fits with 
their tight schedules. 

However, ready access to top poli- 
cy or program people is not always 
possible, and they, too, may have a 
limited or biased understanding of 
issues. As a result, evaluators must 
be aware of others in the organiza- 
tion who have a sense of the issues, 
who have more time to examine and 
discuss them, and who can provide 
other perspectives. 

Knowing who these people are 
and how to locate them is crucial. In 
many cases, they are heads of small 
divisions within the operating pro- 
gram. Because of their position, they 
have a multidirectional view of the 
organization. In any given day, it is 
not uncommon for them to meet with 
top policymakers and with people 
who are carrying out the program. 
From this dual contact, they have a 
picture of the issue from both the 
policymakers’ standpoint and the 
field standpoint. Frequently, these 
people are the ones who can shed 
the broadest and best light on an 
issue. 

While personal exchange, whether 
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it be with formal leaders or informal 
contacts, is vital to discerning is- 
sues, written agency documents also 
play an important role in deciphering 
issues. For legal reasons and rea- 
sons of accountability, administra- 
tors must spell out ongoing and 
proposed policy. More and more, 
agencies must put their intentions 
into writing before taking action. 
These written records can hold the 
key to understanding the policy is- 
sue. For example, at the Federal and 
State levels, memos to the field, draft 
regulations, and public hearings 
commonly outline policy issues. At 
the local level, written decisions of 
legal counsel, minutes of council 
meetings, and labor contracts all can 
be useful in understanding the 
issues. 

Knowledge of general research 
sources can also be useful in issue 
definition. Familiarity with pertinent 
literature and sources of publicly 
gathered information can place spe- 
cific policy issues in a more general 
policy perspective or suggest new 
and innovative ways of dealing with 
the issue. Energy conservation pol- 
icy, for example, has borrowed from 
the pricing arguments of microeco- 
nomic theory as well as from the out- 
reach features of agricultural exten- 
sion services. 


Dealing With Data 


Vital to uncovering existing data is 
knowing who the keepers of the data 
are, what information they have, and 
where these people are located—all 
aspects of knowing the system. The 
keepers of the data, like the data, are 
found in many places. At times, the 
keepers are people in official sound- 
ing places, such as “Records” or 
“Data Processing.” At other times, 
depending on the nature of the data 
needed, the keepers are individuals 
who monitor programs, or program 
operators themselves. 

Ordinarily, the data at the monitor- 
ing and program level are the richest 
and most current but are in a raw 
rather than automated form. Addi- 
tionally, at this level the data are 
often scattered about in many pro- 
gram locations. In these situations, 
the technical aspects of evaluation 
are Critical. For example, if the most 
relevant data for a study are at the 
field level, carefully designed sam- 


pling can be used to collect data 
quickly and in representative form. 
Moreover, these samples do not nec- 
essarily have to be large. When the 
data cover a relatively new program 
or new regulatory or deregulatory ac- 
tion, even a small sample can be 
useful. The small sample will help 
ensure that a rapid feedback is ob- 
tained and will suggest whether 
more intensive sampling is war- 
ranted. 

Effective use of sampling technol- 
ogy can be enhanced with a sound 
grasp of how new and ongoing pro- 
grams work in the field. With such a 
grasp, the evaluator has a much bet- 
ter idea of where to look for program 
change in the maze of interactions. 
Without this insight, valuable time is 
consumed while poorly informed 
searches take place. 

In addition to using organizational 
knowledge and evaluation technol- 
ogy to secure existing data, an eval- 
uator who has a thorough under- 
standing of the agency’s agenda can 
predict many future evaluation re- 
quests, especially those that occur 
periodically. In essence, this knowl- 
edge will allow the evaluator to plan 
for future data needs and to begin 
building a regular, incoming data 
stream in anticipation of those 
needs. 

These new informational flows 
need not always be constructed de 
novo but can be “‘piggy-backed” onto 
surveys or other reporting devices 
which are used in the field on a regu- 
lar basis. A few extra questions, if 
chosen wisely, can enhance eval- 
uation efforts without greatly in- 
creasing costs or resistance from 
the field. 

For both existing and new data, 
there are a number of shortcuts that 
can be used to deal with delays and 
other problems connected with col- 
lecting data in a bureaucratic en- 
vironment. One of these is a carefully 
built personal file of information rele- 
vant to one’s program area. The val- 
ue of such a file is rapid access, 
since it is under the evaluator’s own 
control. The key is to find, retain, 
record, and update information on 
various types of program statistics, 
relevant legislation, important 
memos, and general literature. Pho- 
tocopying tabular information col- 
lected in a case study, retaining 
computer printouts, and getting on 


regular agency routing lists all are 
extremely helpful in circumventing 
the data problems of an agency. 

Another valuable technique for 
data gathering is the telephone inter- 
view. With only a few people calling 
the interviewees, a relatively large 
number of people can be contacted 
in a short time. The value of the 
phone is particularly evident when 
the needed information is spread ina 
wide geographical distribution and 
when it consists of personal assess- 
ments (e.g., characterizing man- 
agement style, moral participation, 
etc.). In this case, the direct give-and- 
take of a phone interview can be es- 
sential in clarifying an issue and 
establishing rapport for later in- 
quiries. 

Admittedly, some of these sugges- 
tions for dealing with data problems 
involve duplicating the respon- 
sibilities of other parts of the 
organization, but the duplication is 
necessary. The division of labor in 
the bureaucracy, so beautifully de- 
signed to provide specialists to 
assist each other, does not always 
work smoothly. As a result, the eval- 
uator must sometimes replicate 
parts of the system to ensure rapid 
turnaround. 


Dealing With Bureaucratic 
Resistances 


Among the several bureaucratic 
realities confronting program evalua- 
tion, bureaucratic resistance is per- 
haps the most difficult to deal with 
and overcome. In contrast to the 
other obstacles, which can some- 
times be handled through per- 
sistence and technological know- 
how, bureaucratic resistance calls 
for knotty ethical decisions, con- 
siderations of power bases, and the 
ability to handle considerable per- 
sonal pressure. Notwithstanding 
these ethical and personal demands, 
the dictum of organizational knowl- 
edge and technological sophistica- 
tion can still yield benefits. 

Bureaucratic resistance is a con- 
tinuing problem for the evaluator and 
can occur at several junctures in the 
evaluation process, including in- 
itiating a study, keeping it afloat, and 
having it used. One of the problems 
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The European Branch: 
GAO in the Center of the 


Old World 


Mack Edmondson, former assistant Branch 
directer, ID/EB, coordinated input for this ar- 
ticle from all EB staff. He noted that 
everyone contributed ideas, paragraphs, or 
pictures and that the entire group enjoyed 
working together to develop the draft. Mack 
also told the Review that the American Con- 
sulate in Frankfurt was making copies of the 
article for its staff and for the consulate 
library. 


This article complements the Summer is- 
sue’s article by Brian Conniff, entitled 
“Working in the European Branch: Adapting 
to a Changing Work Environment,”’ as well as 
the Review's recently completed series on 
GAO's regional offices. 


Frankfurt am Main, one of 
Europe’s most important economic 
and banking centers, is also the 
home of GAO’s European Branch 
(EB) Office. EB staffers claim they’ve 
got the best of the Old World and the 
New because an EB tour offers ev- 
erything one could want in work 
experiences, travel, professional 
challenge, and living conditions. This 
article explains why the staff has 
such high regard for and continued 
attachment to the European Branch, 
while telling you about EB’s people 
and what they do. 


GAO’s Presence In 
Europe 


Following a 1952 GAO survey and 
mounting congressional interest, the 
European Branch headquarters was 
established in Paris that August. A 
field station opened in London at 
about the same time. Soon after, 
three additional European field sta- 
tions opened in Rome, Frankfurt, and 
Madrid. The Branch, together with its 
components, was responsible for all 
GAO work in Europe, North Africa, 
and the Near East. 

Most assigned personnel were at- 
tached to the Paris office, which did 
virtually all the work in Africa and the 
Near East. The heads of these four 
field offices answered to the Paris- 
based director, who oversaw the ov- 
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erall administration and technical 
functions of the Branch. In 1952, 
GAO had no International Division, 
so the director reported directly to 
the Comptroller General through the 
Assistant Comptroller General. 

EB had plenty to do. After World 
War Il, thousands of American 
troops were stationed in France and 
Germany. The U.S. European Com- 
mand had its headquarters at Camp 
des Loges, near Paris, with many 
Army agencies situated throughout 
north-central and central France. 
EB’s work plans also included the 
French ports, which received thou- 
sands of tons of Army and general 
reconstruction supplies; the U.S. 
Navy bases in Spain and England; 
and Air Force installations in France, 
Germany, and England. At the same 
time, U.S. embassies in Europe and 
the Middle East had contingents of 
the Military Assistance Program, the 
International Cooperation Admin- 
istration (predecessor of the Agency 
for International Development), and 
usually the U.S. Information Service. 
With congressional interest in all 
these programs and activities, EB 
personnel had their hands full. 


Paris in the Post-War Era 


Despite the workload, EB staf- 
fers—especially those living in 
Paris—were lucky folk. France con- 
tinued to celebrate the end of its oc- 
cupation, and the atmosphere was 
almost euphoric during those first 
years. America’s Marshall Plan (be- 
gun in 1948 with headquarters in 
Paris) was helping Europe rebuild, 
and Paris soon displayed the dra- 
matic results. Paradoxically, bread 
was rationed for years, but consumer 
goods and entertainment abounded. 
Thus, there were new plays, musicals, 
operas, books, art shows, and lots of 
“new look” Parisian fashions. Staf- 
fers readily shared this excitement. 

Prices were not exorbitant, and 
lucky Americans usually received a 
15 to 20 percent discount on all pur- 
chases in department stores and 


specialty boutiques, if they paid with 
American Express checks. Staffers 
were housed on the French eco- 
nomy, usually in spacious and at- 
tractive quarters, and thus came into 
contact with French citizens every 
day. Our having to learn French 
made everything easier and helped 
us appreciate the joys of living in 
France. 


Sumptuous Quarters 


Our embassy assigned us offices 
in an 18th-century building that now 
houses the U.S. ambassador. Ac- 
cording to EB’s Edith Williams (who 
joined GAO in Paris in 1957), working 
in such surroundings was an inspira- 
tion—the rooms had beautiful panel- 
ing, 20-foot ceilings, parquet floors, 
and huge crystal chandeiiers. An 
Italian marble staircase mounted to 
GAO’s offices, where floor-to-ceiling 
windows overlooked one of the most 
famous private gardens in Paris. 
What a pleasure for those lucky 
enough to work there in those days! 
Just down the street was the Palais 
d’Elysees where the President of 
France lives. The British Embassy 
was next door, and all the deluxe 
shops were nearby. 


The Move to Frankfurt 


In 1963, our embassy announced it 
would not have space for GAO’s of- 
fices in the future, and we should 
make other arrangements. Thus, EB 
moved its headquarters to Frankfurt 
in June 1964 and occupied the home 
of its former suboffice. The move 
was well timed because only 2 years 
later, President Charles de Gaulle 
decreed that NATO and all American 
troops must leave France. The 
Branch was therefore in place and 
functioning smoothly when the bulk 
of U.S. defense agencies, troops, and 
related operations relocated to Ger- 
many. 

By the mid-1960’s, the European 
field stations in London, Rome, and 
Madrid closed, and the Frankfurt 





staff handled GAO’s work through- 
out Europe, Africa, and the Near 
East. Thus, Frankfurt became the 
home of EB and remains so to this 
day. 


Frankfurt: Our Home 
Away From Home 


Frankfurt am Main is the largest 
city in the German state of Hesse, 
with a population of about 700,000. 
Germany’s commercial and financial 
center serves as the “Gateway to 
Europe.” Its airport leads Europe in 
commercial handling and is second 
in passenger travel, while its five 
railroad stations put one in touch 
with the entire continent. The first 
autobahn (still no speed limits) origi- 
nated in Frankfurt. 

This inland city is an important 
port located where the Main River is 
easiest to cross. Documents first 
mention the city in 794, when Char- 
lemagne held a Franconian imperial 
synod in his “villa franconofurd,” 
named for the Franks who forded the 
river at this point. 


A City of History and 
Tradition 


Frankfurt has a long and 
distinguished history of which it is 
justifiably proud. Its Trade Fair has 
been in existence for 800 years. A 
city of books and finance for cen- 
turies, Frankfurt is known in many 
technical fields as the world’s lead- 
ing industrial exhibition center. In 
the 16th century, she received the 
right of coinage. In the 18th and 19th 
centuries, her banking houses held a 
leading position in economic affairs 
and achieved world recognition 
through the banker Rothschild, 
whose five sons founded branches in 
Paris, London, Vienna, and Naples. 
Today Frankfurt is Germany’s finan- 
cial capital and the seat of the 
Bundesbank, the equivalent of our 
Federal Reserve. As the center of 
German book trade and publishing 
business, Frankfurt annually spon- 
sors an international book fair. 

Traditionally, Frankfurt has been a 
city of emperors and politics. For 300 
years it was the coronation city of 
the Emperors of the Holy Roman Em- 
pire, a privilege it retained until 1806. 
Frankfurt remained a free city until 
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Downtown Frankfurt with a view of the Main River. (Photo courtesy German Tourist Of- 


fice, Frankfurt.) 


1866 when Prussia took it over. Vir- 
tually destroyed during World War Il, 
the city was for 5 years afterward the 
seat of the American military govern- 
ment and of numerous allied offices. 
West Germany was then governed 
from Frankfurt, a role which passed 
to Bonn in 1949. 

Until the war, much of the original 
city kept its beautiful, dignified, and 
partrician character. Now almost 
nothing remains of the old buildings 
and crooked medieval alleys. Post- 
war reconstruction in the original 
style was confined to a few historical 
buildings, among them Goethe’s 
birthplace and the city hall, where 
emperors were once crowned. Its 
skyline, now bristling with tall glass 
buildings, marks the city as a child of 
the second half of this century. 


Links Between the Old 
World and New 


Frankfurt has had enduring and il- 
lustrious ties with the New World. 
The first German settlers in North 
America, Protestants from Hesse 


and Alsace, reached Port Royal, in 
present day South Carolina, around 
1562. Peter Minuit, the shrewd 
tradesman who in 1626 bought Man- 
hattan from the Indians for about $27 
in beads, cloth, and peace pipes, 
came from a nearby region. New 
York’s first governor, Jacob Leisler, 
was another Frankfurt resident. 

Early visitors to Frankfurt included 
William Penn, Benjamin Franklin, 
and Thomas Jefferson. In 1788, Jef- 
ferson visited Frankfurt during his 
tenure as Minister to France and re- 
ported his amusement at learning 
“the origin of whatever is not English 
among us. | have fancied myself of- 
ten in the upper parts of Maryland 
and Pennsylvania.” Eighteen Amer- 
ican cities, spread from Maine to 
Kansas and from Alabama to South 
Dakota, are named Frankfurt or 
Frankford. 

Famous Frankfurters who have 
made international contributions in- 
clude Johann Wolfgang von Goethe, 
poet laureate of the German-speak- 
ing world; Philipp Reis, inventor of 
the telephone (contrary to American 
folklore, he beat Bell by 17 years); 
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Otto Hahn, Nobel laureate in phys- 
ics; and Dr. Kurt Debus, director, 
John F. Kennedy Space Center (1963- 
1974). Other notables include com- 
posers Engelbert Humperdinck and 
Paul Hindemith, conductor Georg 
Solti (currently of the Chicago Sym- 
phony), and painter Max Beckman. 


The Cultural Scene 


Our museums alone provide suffi- 
cient incentive for a visit to Frank- 
furt. They include the following 
museums with their particular spe- 
cialties: 

e The Museum of History on the 
Romerberg, sculpture from the Mid- 
die Ages to the present day. 

e The Museum of Ethnology, Third 
World art and artifacts. 

e The Postal Museum, develop- 
ment of communications from antiq- 
uity to the present. 

e The “Stadel,” fine art from every 
period. 

e The Goethehaus and Museum, a 
comprehensive picture of an upper 
class intellectual’s life in the 18th 
century. 

e The Museum of Natural History, 
a million years of human, animal, 
and mineral history. 


if an enjoyable evening’s enter- 
tainment in a foreign city means the 
theater or a concert, Frankfurt will 
suit your taste. There are theaters 
large and small with a wide range of 
repertoires, some presented in En- 
glish. The city’s ultra-modern “‘Stad- 
tische Buhnen” houses an opera 
house, theater, and a small concert 
hall. In August 1981, the Old Opera 
House reopened. Destroyed in the 
war, the structure was _ faithfully 
rebuilt in period design but gar- 
nished with surprising touches of 
modern paintings, electronic/lucite 
sculptures, and sizzling colors. 

If you’re a jazz fan, you’ve come to 
the right place: Frankfurt leads the 
German jazz scene. Concerts take 
place every Sunday morning in the 
Museum of History’s courtyard; dur- 
ing summer months, every Thursday 
evening in the Palmengarten; and at 
unannounced times beneath the 
Hauptwache in the city’s major un- 
derground shopping mall. On Sunday 
mornings, one can enjoy brunch at 
the Hotel International, which 
features traditional New Orleans- 
style music. 
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Typical apartments housing EB staff in Germany. (Photo by Dave Jakab.) 


A nearby community playhouse in 
the military housing complex at- 
tracts many talented members of the 
U.S. forces and agencies, including 
some EBers. And Frankfurt’s profes- 
sional Cafe Theater presents the 
works of English-speaking writers. 


Living and Working in 
Frankfurt 


Frankfurt sits on a wide, fertile 
plain, almost completely surrounded 
by high hills and low mountain 
ranges, which are occasionally visi- 
ble. We have four seasons, much like 
those of the northeastern United 
States, with quite a bit more rain. But 
when the sun does shine, the people 
stroll, bike, sun, and swim at the 
pools and lakes (where one may 
bathe either suited or unsuited). 

We live in a housing area operated 
by the State Department for em- 
ployees of the consulate, attached 
agencies, and some higher ranking 
military officials. This area, official- 
ly Known as the “Carl Schurz Sied- 
lung,” lies on the northwest outskirts 
of Frankfurt. The Siedlung includes 
383 apartments, 3 tennis courts, a 
basketball and volleyball court, 


The German Bundesbank and Park, next 
to the EB housing area. (Photo by Dave 
Jakab.) 





gardens, a field house, and a nursery 
school. Green lawns, picnic tables, 
and shade trees provide comfortable 
spots for barbecuing and relaxing 
with family and friends. Our apart- 
ments are large and quite nice, and 
we feel the Siedlung is an interesting 
and pleasant place to live. 

The EB office is in the consulate 
annex, which is actually two apart- 
ment buildings converted into office 
space. We occupy one-and-a-half 
floors of one building, with round- 
the-clock Marine Guard security. 
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Best of all, the office is a 2- to 
10-minute walk from our apartments. 
Because the Siedlung is only one 
block away from a major traffic ar- 
tery feeding into a complex of super- 
highways, we can get on the road— 
for the day’s work or the weekend’s 
pleasure—within minutes and never 
see a stoplight. Frankfurt’s excellent 
mass transit system is also near. The 
underground (U-Bahn) takes us all 
over Frankfurt. We can also transfer 
to the suburban railway (S-Bahn) and 
visit nearby towns, or transfer to the 
main train station, which connects 
with major European cities. The Ger- 
man trains are immaculate and al- 
ways on schedule. 

Driving is convenient and swift on 
Germany’s superhighways. There are 
no speed limits, although signs fre- 
quently recommend that drivers go 
no faster than 80 m.p.h. Hence, we 
can easily reach Austria, France, 
Switzerland, Holland, Belgium, or 
Luxembourg within 4 to 6 hours. 

The consulate helps us in many 
ways. In addition to providing tele- 
phone switchboard, cable and tele- 
communications, and check-cashing 
services for the office, it also 
registers our cars, gets them in- 
spected, and obtains German drivers 
licenses and internal passports for 
all our personnel. Moreover, it expe- 
dites our moves of household goods 
to and from the Frankfurt post and 
sees that our apartments are metic- 
ulously maintained. The consulate 
also assists with obtaining military 
ID cards (required for shopping at 
PXs), issues gas-purchase ration 
cards, and occasionally arranges in- 
troductions to or meetings with Ger- 
man businessmen or government of- 
ficials. 


One Woman’s Perspective 


Nancy Adair, wife of EB staffer 
Perry Adair and mother of two boys, 
has been here for 2 years. She of- 
fered the following comments on the 
EB living experience. 

Women have many unique oppor- 
tunities in Frankfurt. Career women 
often wonder what they will do in a 
new country, but those who want to 
work, can. Hospital, school, and of- 
fice personnel are easily placed. Oth- 
ers may look a little longer to find 
their career speciaities or may try a 
new field. Several women have sold 


travel articles to magazines, started 
their own businesses, or taught clas- 
ses in crafts and sports. Other 
women make traveling a full-time ca- 
reer. While many enjoy traveling to 
job sites with their husbands, others 
get together in groups and plan their 
own trips. 

Mothers are not apartment-bound, 
either. Day-care centers, nursery 
schools, and neighborhood babysit- 
ters allow them free time to take 
short trips, shop, or enjoy some of 
the local cultural opportunities. 
Some women like to exchange baby- 
sitting to enable each other to take 
longer trips with their husbands. But 
they don’t always leave the kids be- 
hind. Between the museums, zoos, 
castles, and parks, families can truly 
enjoy Germany together. 


Middle Eastern countries. We collec- 
tively logged over three-quarters of a 
million air miles. 

Our staffers get a pretty fair bal- 
ance of at-home and on-the-road 
time. During 1981, travel averaged 
approximately 22 percent of staff’s 
total working hours, with our GS-12s 
and 13s traveling the most. 

Most of our assignments in Ger- 
many are within a 3-hour drive of 
Frankfurt, allowing a quick return 
home on weekends. Thus, privately 
owned vehicles usually get a good 
workout when staffers are working 
and dining on the “Schnitzel Circuit.” 
Traveling in Germany is invariably 
easy. 

Traveling throughout Europe and 
the United Kingdom usually involves 
rail and/or air service. Many staffers 


Pyramids at Giza, Egypt. (Photo by Dave Jakab.) 


The European Branch 
Today 


The European Branch—now part 
of the International Division—has a 
vast territorial responsibility. In fact, 
it would be almost impossible to visit 
all the countries in EB’s territory dur- 
ing a normal 4-year stay in the 
Branch. We cover Europe, Green- 
land, Africa, and the Middle East to 
the eastern border of Pakistan. 


Getting There Is Half the 
Fun 


During calendar year 1981, EB 
staffers worked in 17 European, 3 
eastern European, 16 African, and 4 


prefer reliable European trains to 
conventional air travel, but either is 
comfortable. While some EBers have 
been caught in the midst of Italian 
train strikes, French border searches, 
Iranian civil war, and British air con- 
trollers’ slowdowns, they claim that, 
in retrospect, such “happenings” only 
make their trips more memorable. 


Staffers who've traveled to Africa, 
Asia, and the Middle East usually 
have much to recall. They claim that 
while one can learn to cope with 
anything, stamina and determination 
are a must. And what they can learn 
to cope with frequently includes a 
smorgasbord of shots and pills prior 
to departure, 2 days in transit to their 
destinations, lost luggage upon arri- 
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val, either running water or air condi- 
tioning at hotels (but rarely both 
simultaneously), and omnivorous in- 
sects. Moreover, they may be away 6 
weeks at a time. But EBers rarely 
complain, and a fair number have en- 
joyed returning to Africa and the Mid- 
dle East time and again. 


The Focus of Our Work 


Our work usually relates to the 
Defense and State Departments, the 
Agency for International Develop- 
ment, and allied agency activities 
within our assigned territory. Al- 
though we have spent almost equal 
amounts of time in defense and for- 
eign affairs activities, we also do 
work for CEDD, FPCD, HRD, and oth- 
er Washington GAO divisions. And 
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and puts us in touch with dozens of 
U.S. embassies, consulates, and mis- 
sions. We enjoy good working rela- 
tionships with the military head- 
quarters and the embassies. And we 
depend on their helping our work and 
supporting our review teams so that 
we can serve GAO’s interests. 

The following sketches of recent 
and ongoing work reflect the range 
of issue areas and sheer diversity of 
assignments handled by EB. 


Military Preparedness and 
Logistics Reviews in a 
NATO Environment 


Should the Warsaw Pact forces 
launch a surprise attack on Western 
Europe, American and Allied Forces 
permanently stationed in West Ger- 


: romper reed ee eee 
European Branch staff reviewed the Emergency Deployment Readiness Exercise to 
assess how quickly U.S. troops can mobilize. (Photo by OCPA Photo Team, HQ 
USAREUR & 7A.) 


we sometimes perform studies of 
foreign governments’ programs. In 
many respects, we’re like a regional 
office in the United States. 

Most of our defense-related work 
occurs in Germany, where there are 
three major U.S. military head- 
quarters: the United States European 
Command, in Stuttgart; Headquar- 
ters U.S. Army, Europe, in Heidel- 
berg; and U.S. Air Forces in Europe, 
at Ramstein Air Base. We also do 
various military work in the United 
Kingdom, which has the Headquar- 
ters U.S. Naval Forces, Europe, lo- 
cated in London. Our foreign affairs, 
trade, and development assistance 
work takes us all over EB’s territory 
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many would bear the brunt of the in- 
itial assaults. Military preparedness 
in Europe, therefore, means readi- 
ness for both immediate and sus- 
tained combat. The U.S. European 
Command and NATO are working 
hard in both areas, and the Branch 
reviews the associated programs. 


In recent years the Branch has par- 
ticipated in several highly controver- 
sial reviews of DOD/NATO anti-armor 
weapon capabilities and anti-aircraft 
programs, U.S. combat interoper- 
ability in NATO, and U.S. participa- 
tion in the NATO Infrastructure Pro- 
gram. 


Procurement 


The complex procurement process 
in Europe consists of central, re- 
gional, and ordering offices. The mil- 
itary handles the largest part of pro- 
curement activities in Europe. During 
fiscal year 1981, the military in 
Europe procured about $1.8 billion in 
goods and services. Construction ac- 
counted for about 25 percent of this 
total. The remainder included mis- 
siles and rockets, fuel storage and 
handling, operation of Government- 
owned plants, and general supplies 
and equipment. 

Procurement reviews offer staff 
members a wide variety of assign- 
ments with professional and per- 
sonal opportunities. We regularly ad- 
dress procurement issues affecting 
the United States and our NATO al- 
lies. For example, the Branch par- 
ticipates with auditors from Belgium, 
Denmark, the Netherlands, and Nor- 
way in resolving procurement issues 
on the multibillion-dollar F-16 fighter 
program. 


Communications 


In recent years, the Department of 
Defense has emphasized the com- 
mand, control, and communications 
(C3) aspect of military operations. 
Numerous C3 improvement pro- 
grams costing billions of dollars are 
in the planning stages or underway 
in the European theater. Accordingly, 
EB has worked steadily in the area 
during the last several. years, with 
lead responsibility in several 
instances. Our work has included 
several satellite communications 
programs, electronic counter coun- 
termeasures (ECCM), the Defense 
Communications System in the Euro- 
pean theater, and theater nuclear 
forces C3. 

Although most U.S. forces in- 
theater are in Germany, we have re- 
cently visited U.S. Navy offices in 
London and Naples, U.S. Air Force 
offices in Berlin and Turkey, as well 
as the U.S. Mission to NATO in 
Brussels. 


Support Services for the 
Military Community 


While much of our military-related 
work is in logistics and readiness, we 
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also oversee the many essential 
services and functions that support a 
peacetime force in Europe. For ex- 
ample, we found that operating costs 
could be reduced and services im- 
proved by streamlining the com- 
missary support system. 

Our children attend DOD Depen- 
dents Schools which educate about 
90,000 children in Europe in some 
200 schools. As one would expect, 
managing a school system spread 
from the Azores to the Philippines 
presents unique logistics problems. 
Yet we concluded that the education 
in those schools compares favorably 
with that in stateside schools. 


Personnel Management 


The American military presence in 
Europe has necessitated various re- 
views for GAO’s Federal Personnel 
and Compensation Division. 

The United States currently has 
over 300,000 service members per- 
manently stationed in Europe. Readi- 
ness is a must because mobilizing 
and deploying additional forces may 
not be possible with little warning. 
Thus, the Congress needs to know 
whether these high priority units are 
properly manned, trained, and equip- 
ped to readily perform their mis- 
sions. 

With over 300,000 service family 
members also stationed in Europe, 
the Congress is also interested in the 
Civilian population abroad. Living 
and working in Europe can be a con- 
siderable adjustment for service 
members and their families. The dif- 
fering languages, currencies, cus- 
toms, and, above all, the constant 
emphasis on military readiness, can 
really challenge a service family. 

Within the past year, we have ad- 
dressed such topics as measuring 
soldier skills, the effectiveness of 
single and in-service parents, duty 
time devoted to family and personal 
problems, cost-of-living allowances, 
and soldier education. 


AID and Development 
Assistance 


One of the most interesting ex- 
periences EB offers is an_ ID- 
programmed development assist- 
ance assignment to Africa or the 
Middle East. These assignments 
usually involve the U.S. Agency for 
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International Development (AID) and 
cover such topics as population con- 
trol, agriculture development, health 
care, refugee relief, and international 
disaster assistance. 

Although AID continues to be a 
minor donor in most African coun- 
tries, the United States provides 
more economic assistance to Egypt 
than to any other country in the world 
(over $800 million in 1981). This help 
has fostered recent progress in 
Egypt and the African continent. We 
expect this development assistance 
work will continue, given U.S. com- 
mitment to humanitarian and na- 
tional security interests. 

This work often takes EB staffers 
to exotic locations. Some of our staff 


Rich Stana (I.), EB staffer, discusses U.S. 
refugee assistance with a Chadian 
refugee through an interpreter (r.). 


have visited Peace Corps volunteers 
in remote jungles, refugee camps in 
southern Sudan, and water projects 
in the Sahel. But there are compen- 
sations: field trips and weekend trav- 
el provide such experiences as wild- 
life safaris, visits to the temple at 
Luxor, a glimpse of Victoria Falls, 
and camping within sight of Mount 
Kilimanjaro. 


U.S. Trade and Financial 
Interests 


Through its parent organization, 
the International Division, EB re- 
ceives assignments that help the 


Congress to consider changes re- 
lating to international trade and 
discover ways to improve the 
nation’s exports and financial posi- 
tion. 

EB also studies European coun- 
tries’ policies and strategies for deal- 
ing with their export/import and 
financial interests. Recent assign- 
ments included U.S. and European 
bank lending to developing coun- 
tries, U.S. trade with NATO allies, the 
value-added tax mechanism in 
Europe, taxation of Americans living 
abroad, and U.S. efforts to promote 
exports by small-to-medium busi- 
ness firms. 

The Branch stays abreast of 
significant international trade issues 
by monitoring trade-related publica- 
tions and policy statements emanat- 
ing from the European Economic 
Community’s headquarters in Brus- 
sels and similar documents from the 
Geneva headquarters for the General 
Agreement on Tariffs and Trade 
(GATT). This monitoring assesses 
the implications for U.S. interests 
and whether a GAO survey or study 
might help the Congress. 


International Relations 


Reviewing programs in security 
and U.S. international relations 
brings us assignments with unique 
travel opportunities. One recent re- 
view entailed visiting overseas of- 
fices of the U.S. International Com- 
munication Agency (USICA) to (1) 
evaluate their management, (2) ask 
about headquarters support for their 
activities, and (3) check how well pro- 
gram goals were articulated and 
achieved. We worked with ambas- 
sadors, USICA officials, and other 
embassy personnel in the United 
Kingdom, the Netherlands, Greece, 
France, Yugoslavia, Poland, Kuwait, 
South Africa, Nigeria, and Tanzania. 
USICA subsequently established a 
special committee to respond to the 
problems of focus, management, 
and support found during GAO’s 
review. 

In another review, we helped to 
evaluate the State Department’s ov- 
erseas security measures to protect 
U.S. citizens and property in “high 
threat” posts. We assessed a multi- 
million-dollar security enhancement 
program mandated by Congress. At- 
tacks on U.S. personnel and facilities 
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in Iran and Pakistan sparked this pro- 
gram. 


Energy and Related 
Technologies 


World events and subsequent con- 
gressional legislation have focused 
attention on the international energy 
market. Part of our work in Europe 
entails evaluating U.S. participation 
in international energy organizations 
that coordinate policy about the 
availability, use, and distribution of 
worldwide energy supplies. Two 
such organizations are the Interna- 
tional Atomic Energy Agency (IAEA) 
in Vienna and the International En- 
ergy Agency (IEA) in Paris. At the 
IAEA, for example, we evaluated the 
effectiveness of the U.S. efforts to 
improve the agency’s international 
nuclear safeguard system. This 
formed part of GAO’s overall assess- 
ment of the Nuclear Non-Prolifera- 
tion Act of 1978. At the IEA we 
reviewed the impact on U.S. oil 
reserves when the agency must res- 
pond to short-term oil supply disrup- 
tions like those which occurred dur- 
ing the past decade. 


International 
Organizations 


EB’s territory contains some of the 
world’s foremost international or- 
ganizations. These include the Or- 
ganization for Economic Coopera- 
tion and Development (Paris), the 
U.N. Food and Agriculture Organiza- 
tion (Rome), and the U.N. Industrial 
Development Organization (Vienna). 

EB teams usually work at several 
of these organizations each year, ar- 
ranging the visits, conferences, and 
interviews through the official U.S. 
mission attached to each entity. Fre- 
quently we review U.S. interests and 
extent of participation in these or- 
ganizations. On occasion we visit 
them for technical studies and ex- 
pert opinions on specific U.S. pro- 
grams and initiatives. 


Branch Organization 
and Personnel 


The Branch’s work is ably guided 
by its director, Fred Layton, and two 
assistant Branch directors, Jerry 
Huffman and Dick Price. Traditional- 
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ly, one assistant manages Interna- 
tional Division work, while the other 
covers defense-related work. Thus, 
they handle an average of 20 jobs at 
any one time. 

Remembering developmental 
needs and stated subject area prefer- 
ences, EB strives to give staff a diver- 
sity of work experiences and travel 
opportunities. After their second or 
third year in EB, people who plan to 
return to a particular division or 
region concentrate to the extent pos- 
sible in such specific subject areas 
as military readiness, communica- 
tions, or foreign aid programs. 

Staff representatives help guide 
the Branch’s operations. EB’s most 
active group is the Career Level 
Council, currently chaired by Jack 
Belz. The CLC recently surveyed 
GS-12 perceptions concerning 
Branch management practices, EB 
operations, and work trends. The 
Mid-Management Council, chaired 
by Dan Spengler, also contributes 
ideas and opinions to EB’s manage- 
ment staff. 


Meet the Branch Staff 


In addition to the Branch direc- 
torate, 36 evaluators and 5 support 
staff work in Frankfurt. EBers make 
up a good cross-section of GAO em- 
ployees; 9 of the Washington divi- 
sions are represented and 11 of the 
15 regional offices. There’s about a 
50-50 split between headquarters 
and field alma maters, with ID, HRD, 
MASAD, and PLRD providing the 
strongest representation from Wash- 
ington, Denver. Seattle, Los Angeles, 
Boston, and Washington regional of- 
fices carry the FOD banner. 

The living environment and chal- 
lenging work must agree with the 
staff, since almost everyone signs on 
for a second 2-year tour. 

Our administrative support staff 
provides stability and continuity. The 
director’s secretary, Edith Williams, 
and our travel specialist, Louise 
Markray, have 27 years of EB ex- 
perience between them. Edith has 
worked for 10 Branch directors. Ann 
Wylie, Margie Walter, and Susan 
Roiger form the rest of our “back- 
bone.” 


Outside Activities 


An important work-related outside 
activity for the Branch is the Central 


Germany Chapter of the Association 
of Government Accountants (AGA). 
Five EBers have been nominated for 
AGA’s Board of Directors this year. 
Living and working in foreign 
countries naturally creates some in- 
teresting language challenges for 
EBers. In its “language bank,” EB 
currently boasts German, French, 
Italian, Spanish, Arabic, and Hebrew. 
Recreational opportunities abound. 
Superb ski slopes are only hours 
away by car or bus. The Frankfurt In- 
ternational Tennis Club—located 
right in our housing area—remains a 
focal point during our all-too-brief 
spring and summer months. GAO 
staffers put in a full winter season 
with the American Consulate Bowl- 
ing League. It couldn’t be more con- 
venient: the lanes are only a block 
away! Come spring, GAO teams up 
with the Marine Detachment and oth- 
er consulate employees for a slow- 
pitch softball league. And some play 
basketball with a German sports 
club—an excellent way to get to 
know our German neighbors and 
sharpen our language skills. 


German Sights and 
Scenery 


Both U.S. airlines and Germany’s 
Lufthansa have daily flights from ma- 
jor U.S. cities to Frankfurt, with con- 
necting flights available to European 
cities. Here one can buy a Euro-Rail 
Pass for economy and first-class 
comfort. The excellent train service 
takes you to most German towns. 
You can visit 16th century framework 
houses in Bernkastel’s market place, 
the walled medieval town of Rothen- 
burg, the cathedral in Cologne, or the 
Black Forest of Bavaria. 

The scenic little Bavarian towns of 
Garmisch and Berchtesgaden, sur- 
rounded by majestic mountains, are 
within easy reach. Through the 
Army’s recreation centers, one may 
ski or hike in the immediate area or 
tour King Ludwig’s famous castles, 
Neuschwanstein (the inspiration for 
Disneyland) and Linderhof. 

Closer to Frankfurt, a Rhine River 
cruise on Sunday afternoon can be 
enjoyed by the whole family. Be- 
tween Bingen and Koblenz, the river 
winds through a narrow valley with 
vine-covered hiils dotted with 
castles. 

No trip to Germany is complete 
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without a visit to Berlin, whose 
modern buildings, world-famous 
symphony orchestra, and cabarets 
and nightlife leave indelible impres- 
sions. Here you can cross the Berlin 
Wall to see life in the East Sector. 
Nothing can prepare you for the 
drama of passing back through 
Checkpoint Charley into the freedom 
and beauty of life in West Berlin. 
Only an hour’s drive from Frank- 
furt lies Heidelberg, authentic scene 
of the operetta “The Student Prince,” 
and home of Germany’s oldest uni- 


centuries. The world-famous Okto- 
berfest is certainly the biggest festi- 
val paying tribute to German brewing 
skills, with the best beer of all 
available in Munich. In addition, one 
may find hundreds of small and large 
wine festivals throughout Germany, 
where one quickly learns the mean- 
ing of the term “Gemuetlichkeit” — 
the German word for cordiality and 
comradeship. 

Christmas is a very special time of 
year in the land which gave us the 
custom of decorating a pine tree, or 


The “Apple Wine Express” trolley in downtown Frankfurt. (Photo courtesy German 
Tourist Office, Frankfurt). 


versity (since 1386). From the moun- 
tains above the city, one can see the 
old castle and the town spread below 
along the banks of the Neckar River. 

Heidelberg gives you Germany’s 
marvelous diversity in a nutshell. 
Here you can find prehistoric, Celtic, 
and Roman remains. Within the old 
city, you’ll find the 15th-century Holy 
Ghost Church, renaissance-period 
student taverns, discos, and jazz 
clubs. 


Holidays and Festivities 


We in EB love to participate in the 
traditional celebrations, both reli- 
gious and secular, which the 
Germans have cherished over the 
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“Tannenbaum,” for the holidays. 
Nothing imparts more of a festive 
atmosphere than a visit to the Christ- 
kindImarkt in Nurnberg, where ven- 
dors offer beautiful handmade orna- 
ments, tasty Lebkuchen, and hot, 
spiced Gluehwein to ward off the 
chilly weather. 


We no sooner wind down our 
Christmas and New Year’s celebra- 
tions than the German “Fasching” 
season begins. Like Mardi Gras, this 
6-week season culminates with spec- 
tacular parades and gigantic cos- 
tume parties. During Fasching even 
the most staid Germans cast aside 
their inhibitions and don bizarre and 
outlandish costumes. 


Food and Drink 


For many of us, eating our way 
across the European continent is a 
continuing highlight of our EB tour. A 
German meal represents the epitome 
of fine food at a reasonable price. Al- 
though German restaurants are often 
relatively small, family-run enter- 
prises, most offer a good selection 
and provide generous portions. As 
you travel, expect to find several 
dozen varieties of excellent wurst 
and countless variations in the basic 
(veal) schnitzel. These two entrees 
usually form the nucleus of a hearty 
dinner. Regional favorites are well 
worth a try, particularly Bavarian sch- 
weinehaxen (pigs’ knuckles) and 
smoked Black Forest ham. Good 
food naturally requires the company 
of good drink, and Germany pro- 
duces beer and wine in tremendous 
quantity and quality. 

While comprehending the menu 
may be the major obstacle facing 
most Americans, an awareness of 
certain dining customs is also impor- 
tant. The waiters bring each indi- 
vidual’s plate as it is ready, so if you 
are served before anyone else, it is 
perfectly acceptable to begin eating. 
Probably the most appreciated cus- 
tom is the inclusion of both tax and 
tip in German menu prices. 


A Word From the 
Director 


Fred Layton became the director 
of the European Branch in the sum- 
mer of 1980, after serving for 4 years 
as manager of the Boston regional 
office. Now, after 2 years in Frank- 
furt, Mr. Layton offers the following 
comments on the Branch and staff. 


“We seek to (1) improve our prod- 
ucts and relationships with our head- 
quarters customers, (2) maintain 
good relations with the European 
military commands and U.S. embas- 
sies throughout our territory, and (3) 
help our staff develop. We are es- 
pecially proud of our rigorously se- 
lected EB staff. In 1982, more than 50 
applicants competed for 4 vacan- 
cies. 

While part of the International Divi- 
sion, our operations resemble those 
of other GAO field offices. Our work- 
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Adapted from an article on evalua- 
tion management, publication pend- 
ing, New Directions in Program Eval- 


uation, Jossey-Bass. 


What do we mean by quality in pro- 
gram evaluation? How can we define 
and measure it so that we can see if 
we are improving it? These are basic 
questions of evaluation manage- 
ment, questions which are raised 
almost continually by managers and 
staff at GAO and elsewhere. But 
these questions have tended to re- 
ceive somewhat unsatisfactory an- 
swers largely because there exists 
neither a clear consensus on the 
subject nor an adequate operational 
definition of what may constitute 
evaluation quality. Yet managing 
evaluations requires some sort of 
system for measuring, improving, 
and accounting for their quality. Def- 
inition is at the heart of any such 
system. 

Defining evaluation quality, then, 
may well be basic to the task of im- 
proving it. But such definition is not 
easy because quality is relative to an 
observer (i.e., quality in one place or 
to one person may not be quality in 
another place or to another person), 
and because quality is relative also 
to the conditions imposed on the 
work. 

Nonetheless, sooner or later all 
evaluation managers must develop a 
way of defining and measuring the 
quality of their products, both to 
maintain their excellence and useful- 
ness and to ensure their continuing 
improvement. But somehow, evalua- 
tion staff members tend to resist 
managerial edicts that a piece of 
work “took too long,” “cost too 
much,” or was “lacking in quality.” 
They point out that such criticisms 
are unhelpful either in clearly identi- 
fying what went wrong or in explain- 
ing just what it is that should be 


done differently next time. Put anoth- 
er way, these kinds of criticisms do 
not generate objective measures 
capable either of describing current 
performance or of accounting for fu- 
ture progress. 

In effect, if it is said that a job 
“took too long,” then the question 
must be answered: How much time 
should it have taken? Yet such a 
question cannot be answered in and 
of itself. The time a job would take 
depends, among other things, on the 
job’s difficulty, on the importance of 
the subject, on the staff’s expertise, 
and on whether the user needed the 
job at a certain date. Thus there is no 
simple way of determining how long 
a job should take without also con- 
sidering other factors. Again, if a 
manager judges that a job “lacked 
quality,” what then is the “right” way 
to do the job? That again depends 
upon such things as the costliness, 
feasibility, and applicability of dif- 
ferent designs, the time it would take 
to execute them versus the time 
available, and, of course, the difficul- 
ty of the question posed relative to 
staff capabilities. The problem with 
assessing quality by itself is that the 
“right” way to do a job can only be 
determined in terms of the question 
posed and in terms of cost, time, and 
feasibility constraints. 

Another difficulty in looking only 
at particular aspects of job quality is 
that, taken separately, the aspects 
cannot inform us on the whole job, 
on whether we are moving forward or 
backward, or on whether our evalua- 
tions are improving. Reducing time 
on a job might be at the expense of 
augmenting cost and diminishing 
quality. Reducing cost might pre- 
clude using the only design allowing 
a relevant answer to a sponsor’s 
question. Reducing rigor of design 
might not increase rapidity or de- 
crease cost. Therefore, looking at in- 
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dividual factors, such as time, cost, 
or quality, can paint a misleading 
picture both of current performance 
and of likely or possible future pro- 
gress. 

What seems most important in ar- 
riving at a definition of quality, then, 
is to understand and account for the 
dynamic relation among the quality, 
the time spent, and the costs of a 
job. It is the nature of this relation- 
ship that allows (1) an overview of the 
evaluation process, which can in- 
form managers and staff on what is 
strong, what is weak, and what 
needs improvement in their perform- 
ance; and (2) the development of 
measures which can track changes 
in that performance over time. In 
GAO’s Institute for Program Evalua- 
tion (IPE), we have been structuring a 
management system based on such 
a definition. This article documents 
our efforts in that area. 


Defining Evaluation 
Quality 


The definition of evaluation quali- 
ty, then, needs to involve a set of re- 
lationships. Like all such definitions, 
it requires the simultaneous process- 
ing of several elements of informa- 
tion. For example, the technical 
soundness of a report defined in this 
way would be determined as a func- 
tion of the time allocated to is per- 
formance, the costs required to pro- 
duce it, and the adequacy of the ap- 
proach, methodology, or procedure 
employed. 

This is not, of course, to assert 
that evaluation quality in a report is 
exclusively a matter of technical 
soundness. On the contrary, to fulfill 
the purposes of doing any evaluation 
in the first place, that evaluation 
needs not only to be technically 
sound but also to be useful, if it is to 
have impact. Therefore, the defini- 
tion of evaluation quality being pro- 
posed here necessarily includes two 
components. Let us call them tech- 
nical adequacy and usefulness. 


Technical Adequacy as 
a Component of 
Evaluation Quality 


The notion of technical adequacy, 
reflecting that of evaluation quality, 
is relative because it depends upon 
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the requirements or constraints put 
upon the work whose technical ade- 
quacy is to be assessed. These con- 
straints must always include the 
type of information to be produced 
(i.e., the kind of question posed) the 
funds available to produce the infor- 
mation, and the time given for pro- 
ducing it. As with quality, there is no 
such thing as “absolute” technical 
adequacy; that is, conclusions about 
technical adequacy, to be properly 
drawn, must take account of the con- 
straints. For example, all questions 
are not necessarily ‘evaluable.’ 
Some are so broad that they cannot 
be answered. Some involve assump- 
tions that are difficult to test in the 
field. Some presume expertise that is 
beyond the state of the evaluative 
art. Yet it goes without saying that 
even the most rigorously planned 
and executed evaluation would have 
to be considered inadequate if it 
were designed to address the wrong 
question (that is, a question different 
from the question posed). Again, a 
technically sound evaluation that 
came in 2 years too late and cost 
more than its topic justified would in- 
dicate that the design chosen was 
overly ambitious, with respect to the 
resources available. 

The point here is that the relative 
nature of technical adequacy, like 
that of evaluation quality, again im- 
poses a definition requiring a bal- 
ance among various elements. The 
first factor to be considered in the 
technical adequacy component, 
then, is that of design, since it is the 
design process which refines and es- 
tablishes the evaluation question 
and which resolves, at the start of an 
evaluation, the problem of meeting 
an information need reasonably, 
within time and cost constraints. 
Therefore, managers should first 
measure technical adequacy at the 
end of the design phase, examining 
issues such as the following: Was 
the evaluation question well de- 
fined? Was it “evaluable,” or did it 
need modification? Was it renegoti- 
ated with the sponsor? Is the design, 
as it now stands, powerful enough to 
answer the evaluation question 
posed? Is it too powerful, perhaps? 
Does it call for the collection of 
massive amounts of data that aren’t 
really needed for answering the 
question? Does it involve unneces- 
sarily elaborate procedures—given 


the question—which may be elegant 
but which will increase the cost and 
take too long? Is it feasible to per- 
form? 

An important factor in technical 
adequacy is, therefore, the ap- 
propriateness of the evaluation’s de- 
sign for answering the question 
posed, within the time and cost pa- 
rameters assigned. Managers and 
staff can gain two advantages by re- 
viewing these and other issues at the 
end of the design phase. The first is 
building in considerations of quality, 
time, cost, and feasibility very early 
in a job; the second is setting up a 
baseline of expectations against 
which the finished evaluation can be 
compared. 

Let us say, then, that we have a 
question that can be evaluated and 
that an appropriate design has been 
developed: a design which is tech- 
nically sound and which considers 
time, cost, and feasibility con- 
straints. Next, managers and staff 
are faced with the challenges of im- 
plementing or executing that design, 
so a second technical adequacy fac- 
tor comes into play, which also in- 
fluences evaluation quality. That fac- 
tor has to do with the way the work 
was Carried out, and once again, it is 
a matter of appropriateness; it is 
relative. In assessing technical ade- 
quacy at the end of a job, then, the 
manager can address issues such as 
the following: Did the site or case 
selection process make sense in 
terms of the evaluation question 
asked and in terms of the resources 
available? How well did the design 
work? Did staff have problems apply- 
ing it in the field? If so, how were 
these problems resolved? How con- 
clusive is the evidence obtained rel- 
ative to what was expected (based 
on the design) and what was needed 
(based on the question)? Was a care- 
fully developed data collection in- 
strument used to ensure that the 
data collected were those required 
by the design? Were interviews con- 
ducted in a manner allowing quan- 
titative and/or qualitative analysis 
(that is, was the interview instrument 
formatted with forethought regard- 
ing the mode of analysis to be per- 
formed)? Were the statistical tests 
applied appropriate? Do the conclu- 
sions and recommendations flow 
from the design and from the work 
performed? 
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In reviewing technical adequacy, it 
is important to remember the number 
of viable options and correct ap- 
proaches which may be employed 
with respect to both design and ex- 
ecution. There is no perfect strategy; 
many strategies are possible for al- 
most every question. However, it is 
also true that every option usually 
implies some trade-off witn another 
option. “Getting something” typ- 
ically means giving up something 
else. This is the main reason for con- 
sidering the advantages and disad- 
vantages of various design and 
execution strategies at a job’s initia- 
tion phase and for returning to them 
during the course of execution, if 
need be. 

Defining the component of tech- 
nical adequacy, then, does not stop 
at consideration of the evaluation de- 
sign. It also involves a second factor: 
the appropriateness of the eval- 
uation’s execution in terms of the de- 
sign selected and the resources in- 
volved. 

Even though both of these first 
two factors are defined as relative, 
managers and staff can nonetheless 
use them to arrive at fairly precise 
judgments about technical adequa- 
cy. In the case of the first factor, 
design appropriateness, one possi- 
ble design option, is compared with 
another in terms of time to comple- 
tion (given, for example, a cus- 
tomer’s need for speed), in terms of 
cost (when two designs do about 
equally well in answering a question 
rapidly), in terms of likely feasibility 
(data availability, for example), and in 
the traditional terms of information 
conclusiveness (i.e., the relative pow- 
er of each design). In the case of the 
second factor, execution appropri- 
ateness, performance is compared, 
first, to what was expected at the 
end of the design phase with respect 
to time, cost, and evidence obtained; 
and second, to other evaluations in- 
volving similar problems of execu- 
tion. 

A final factor, however, can add to 
the general precision by including 
one nonrelative concept of technical 
adequacy. This has to do with the le- 
gitimacy of the technical approach 
and procedures employed. Although 
there are many correct approaches 
to evaluation design and execution, 
as already noted, there also exist 
some patently incorrect approaches, 
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the use of which would necessarily 
degrade evaluation quality. There- 
fore, in addition to monitoring the ap- 
propriateness of the evaluation’s de- 
sign and execution, managers need 
to be alert to the following kinds of 
general problems which can crop up 
during the design, conduct, or report- 
ing of an evaluation: Did staff gener- 
alize from a case study? Use inap- 
propriate statistical procedures? Fail 
to note the importance of a sizable 
number of nonrespondents to a 
questionnaire? Unintentionally dup- 
licate another study or miss an im- 
portant issue through lack of an ade- 
quate literature review? Attribute 
observed changes to a program with- 
out ruling out other possible causes 
for the changes? Make conclusions 
and recommendations not warranted 
by the power of the design or the 
work performed? Omit returning to 
modify the evaluation design (or if 
necessary, the evaluation question) 
when serious problems have arisen 
during the course of execution? Any 
of these problems—and there are 
many others—would sharply erode 
technical adequacy and influence 
evaluation quality. 

Defining technical adequacy thus 
involves a third factor: the absence 
of major conceptual errors, inappro- 
priate technical procedures, and im- 
proper conclusions or inferences. 

In summary, the three factors of 
technical adequacy given above as- 
sume that (1) if an evaluation fea- 
tures a design appropriate for an- 
swering the question posed within 
the time period and funding allo- 
cated, (2) if that design is executed 
rationally and defensibly, obtaining 
the evidence needed or expected, 
and (3) if no major errors are made in 
design, performance, or reporting, 
then it can reasonably be argued that 
the basic requirements of technical 
adequacy have been fulfilled. 


Usefulness asa 
Component of 
Evaluation Quality 


Usefulness is the second compo- 
nent of evaluation quality proposed 
in our definition. Once again, we are 
dealing with a relative concept, since 
usefulness can only exist with 
respect to a user and a use. Four fac- 
tors of usefulness to the congres- 


sional customer have been dis- 
tinguished by the GAO.’ These are 
relevance, timeliness, presentation, 
and impact. (While other aspects of 
usefulness certainly exist, some of 
these—such as lucky circumstances 
which unexpectedly may make a re- 
port timely—are not controllable by 
managers or staff and hence are out- 
side the scope of this discussion.) 

The relevance of an evaluation’s 
findings to an information need is a 
critical factor of usefulness. Find- 
ings that are used are generally 
those that address questions which 
policymakers themselves want an- 
swered for some specific purpose. 
Relevance, then, is defined here as 
the close logical relationship with, 
and importance to, a matter under 
consideration. 

The timeliness of an evaluation’s 
findings, with respect to a user’s 
need and a projected use, is an 
equally critical factor of usefulness. 
A relevant report may not serve at all 
if it is delivered too late; results must 
be obtained and reported before, not 
after, the issue in question has to be 
decided. Timeliness is defined here 
as delivery of pertinent findings at an 
appropriate date: a date on which de- 
livery is most likely to be of help or 
service to the user. 

The presentation of a report is as 
critical a factor of usefulness as are 
relevance and timeliness. Results 
must be communicated in a form 
that the user finds comprehensible 
and congenial, otherwise even rele- 
vant, timely reports may not find 
their audience. Presentation quality 
is defined here as that organization 
of a report—according to the con- 
ventions of logic, clarity, balance, 
and good writing—which is most ap- 
propriate to a user’s needs. 

These three factors of usefulness 
are controllable by staff but are 
assessable only by the user. There- 
fore, it is important for managers to 
assure that staff build in, during the 
negotiation phase of an evaluation, a 
clear agreement with the evalua- 
tion’s sponsor not only about (1) the 
precise nature of the question posed 
and the level of confidence required 





'See, for example, Elmer B. Staats, 
Remarks to the Evaluation Research Soci- 
ety’s Annual Convention, in Austin, Texas, 
Oct. 3, 1981. 
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in the answer, (2) the relevance of 
that question to the user’s need, (3) 
the date on which the information 
must be available, and (4) the presen- 
tation aspects of the information 
delivery, but also (5) the manner in 
which the information is to be used. 
Post hoc tracking of actual use 
typically yields only limited informa- 
tion if expectations for use have not 
been discussed so that relevant mea- 
sures can be planned and developed. 
This is especially true when the kind 
of use involved has been intangible 
(e.g., the sponsor’s use of a report to 
develop a concept, to persuade oth- 
ers, or to negotiate a policy), that is, 
when the use is not clearly reflected 
in the end result. 

As already noted, all three of these 
usefulness factors are relative con- 
cepts, defined by their appropriate- 
ness to the user need. All three 
enhance the likelihood that an eval- 
uation’s findings will be used. There- 
fore, the manager needs to ensure, at 
the design stage, that all three are 
built into the evaluation’s perfor- 
mance, and, at the end of the execu- 
tion stage, that the user has reviewed 
and assessed the evaluation’s 
usefulness in terms of timeliness, 
relevance, and presentation. 

The impact of a report is the fourth 
factor of usefulness (and the seventh 
of evaluation quality) to be examined 
here. Impact is complementary to the 
other three factors in that it refers to 
actual, validated use, as opposed to 
usefulness. At GAO, impact is de- 
fined in terms of accomplishments: 
the demonstrable use (or influence) 
of a report’s findings and recommen- 
dations in (or on) legislation, agency 
decisionmaking, administration, or 
management (for example, savings 
achieved as a result of the report). 
Impact, then, is evidence of actual 
use. It strengthens the definition of 
the usefulness component in that it 
provides at least one indicator, in- 
dependent of the user’s opinion, that 
an evaluation’s findings have in fact 
been used. 

The third factor of the technical 
adequacy definition discussed ear- 
lier in this section—that is, “the 
absence of major conceptual errors, 
inappropriate technical procedures, 
and improper conclusions or infer- 
ences”—has the same function for 
that component of evaluation quality 
as does impact for usefulness: it 
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serves as a nonrelative indicator of 
technical adequacy. Such indicators 
are needed in our overall definition to 
ensure the discovery of the ‘smoking 
gun,” that is, either the existence of 
a serious technical failure despite 
appropriate design and execution or 
the existence of nonuse despite 
glowing customer satisfaction. 


Measuring Evaluation 
Quality 


Evaluation quality has now been 
defined as composed of two com- 
ponents: technical adequacy and 
usefulness. Each of these com- 
ponents has been structured to in- 
clude several defined factors, seven 
for the two components. We must 
now look for some possible ways by 
which managers can proceed to 
measure those factors. A first effort 
at measurement—still under devel- 
opment at IPE—is shown in table |. 

Some of the measures for tech- 
nical adequacy in the design phase 
(I,1) must, of necessity, be approx- 
imate, since they are planning esti- 
mates. For example, the cost of im- 
plementing an evaluation design can 
only be roughly projected; therefore, 
the measure invoked here is one of 
relative cost, as between one design 
and another (e.g., a short case study 
versus an outcome evaluation or a 
survey). Feasibility and _ time-to- 
completion, again, can usually be on- 


ly crudely guessed at. However, the 
adequacy of the design for answer- 
ing the question posed can typically 
be ascertained, as can the agree- 
ment on user needs. 

With regard to the technical ade- 
quacy of execution (1,2), the first mea- 
sure—adequacy in terms of de- 
sign—seeks to establish the degree 
of match between the front-end plan- 
ning phase and conditions in the 
field. Managers and staff determine 
this by comparing what the design 
anticipated and what was, in fact, 
achieved. The second measure 
speaks to the way in which any mis- 
match problems were resolved. Here, 
feedback from field staff to the 
evaluation manager is the informa- 
tion which needs to be obtained. 
Adequacy in terms of costs and mile- 
stones, the third measure, involves 
two comparisons: (a) final cost and 
time-to-completion versus projected 
cost and milestones; and (b) costs 
and time-to-completion versus those 
achieved in other evaluations using a 
similar design. This allows managers 
to pinpoint, for each evaluation, the 
reasons for delay, the locus (or loci) 
of delay, and the elements of unex- 
pectedly increased cost. The great 
advantage here is that, once these 
problems have been precisely iden- 
tified across a number of evalua- 
tions, progress in each of these 
areas can then be tracked over time. 
The fourth and fifth measures ad- 
dress goals of early warning. When 





|. Technical Adequacy 


Factors Measures 


Table | 


Definition of Evaluation Quality: Seven Factors and Their Measurement 


ll. Usetuiness 


Factors Measures 


(1) Appropriateness of 
Design to Evalua- 
tion Question/Cost/ 
Time 


(2) Appropriateness of 
Execution to Ques- 
tion/Design/Cost/ 
Time 


(3) Absence of Major 
Technicai Errors in 


(1) (a) Adequacy of selected design for 
answering the question posed 
(b) Feasibility of implementing the 
design in required timeframe 
(c) Minimization of costs with re- 
spect to the question posed 
(d) Specification of agreement with 
user on what the question is, 
how the report will be used, when 
it is needed, and how use will be 
measured 

(2) (a) Adequacy of execution in terms 
of the design requirements 
(b) Appropriateness of design revi- 
sions to conditions in the field 
(c) Adequacy of execution in terms 
of projected costs and mile- 
stones 
(d) Adequacy of monitoring and re- 
porting on design/time/cost prob- 
lems 
(e) Adequacy of tracking of cus- 
tomer satisfaction and impact 

(3) (a) Adequacy with respect to tech- 





(b) Adequacy with respect to the 





sign, 
and Reporting 





accuracy of what is reported 


(4) Relevance to 
user informa- 
tion need 


(5) Timeliness 


(1) (a) Prior agreement of user with 
regard to question(s) report 
will address 
(b) Prior awareness by user of 
report limitations (conclu- 
siveness, etc.) 
(c) User satisfaction after re- 
port delivery 


(2) (a) Prior agreement with user 
(b) Information delivery by due 
date 
(c) User satisfaction after re- 
port delivery 





(7) Impact 


(3) (a) Adequacy of logic, organiza- 
tion, and writing 

(b) User satisfaction after re- 
port delivery 


(4) (a) Prior agreement with user 
on how the report will be 
measured 
(b) Evidence of policy use 
(c) Increased productivity 
(d) Improved management 
(e) Savings achieved 
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problems arise, either with evalua- 
tion performance or with customer 
satisfaction, the sooner the prob- 
lems are discovered, the more likely 
they are to be resolved. Thus, these 
measures compare the dates at 
which problems have appeared with 
the dates when they have been iden- 
tified, either through performance 
monitoring or tracking of use. 

Measures for the third factor of 
technical adequacy (I,3), such as 
specifying conceptual errors, inap- 
propriate procedures, and improper 
conclusions or inferences, are not 
fleshed out here since knowledge in 
this area is widespread, nothing in- 
novative is intended, and the list 
would be extremely long. For exam- 
ple, using correlational analysis to 
make conclusions about cause-and- 
effect relationships or overlooking 
the importance of a defined universe 
would reduce the technical credibili- 
ty of any report. But, in addition, 
such errors should draw the atten- 
tion of the evaluation managers to 
needed training for staff. 

The measures of usefulness fac- 
tors given in table | (ll, 1, 2, 3, 4) all 
seek to reinforce the performance of 
specific upfront negotiations with 
the customer and the formal tracking 
of customer satisfaction and use. 
Here, feedback from the user to the 
evaluation manager is the critical in- 
formation needing to be obtained. 


Discussion 


The above effort to define and 
measure evaluation quality is, of 
course, an initial attack on a difficult 
management problem. As they un- 
dergo testing and development in 
IPE, the various concepts will need 
to be amended, revised, refined, and 
improved. But the overall approach 
affords several advantages. 

First, it moves managers out of the 
realm of static, ad hoc criteria, infor- 
mally applied. The appraoch taken 
here instead is both formal and dy- 
namic; it tries to ensure that all 
elements directly affecting the devel- 
opment and measurement of evalua- 
tion quality can be included, docu- 
mented, and accounted for in terms 
of their relation to each other. Addi- 
tional elements can, of course, be in- 
serted in this framework, and the 
evaluation manager can accommo- 
date his or her views of what is most 
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important by differential weighting 
of the elements or components to be 
reviewed. 

Second, this approach allows the 
manager to find multiple measures 
of progress in evaluation quality over 
time. This is done with regard to 
technical adequacy by incorporating 
into the assessment not only the 
soundness of the design from a 
strictly methodological viewpoint, 
but also the consideration of the 
question posed, that of design fea- 
sibility, and of the time and funds 
available. With regard to usefulness, 
this is done by incorporating into the 
assessment the consideration of the 
use itself, of the user need, and of 
user Satisfaction. 

Third, this approach can help to 
achieve needed control of resources 
and improvements in productivity by 
showing the need for technical de- 
sign review by managers early 
enough in the job to ensure the effec- 
tiveness of the design strategies 
adopted with regard both to cost and 
to the likely timeframe required for 
performance. Evaluation quality can 
never, under any definition, be 
equated with length of time and high 
costs. Rather, quality is achieved 
when a design is the best possible 
one, given the time and funding 
available. This, of course, is a matter 
of common sense: it is no more true, 
for example, that high costs and 
length of time necessarily generate 
high quality than it is true that low- 
cost, rapid efforts must necessarily 
result in poor quality. Thus, the ap- 
proach promotes attention to re- 
source expenditures by making them 
a function of evaluation quality. 

Finally, by separating technical 
adequacy from usefulness, the ap- 
proach avoids confounding the two, 
and this is important because con- 
fusing them can impede the effort to 
improve either one. The reason for 
this is that technical adequacy alone 
does not ensure usefulness: many 
excellent studies have gathered dust 
on policymakers’ shelves. In the 
same way, usefulness cannot speak 
to the question of technical ade- 
quacy: many well-used evaluations 
have been technically mediocre. Said 
another way, this means that cus- 
tomer satisfaction is an excellent 
way of measuring usefulness but not 
technical adequacy, and methodo- 
logical review is an excellent way of 


measuring technical adequacy but 
not usefulness. Therefore, care was 
taken in developing this approach to 
(1) assure a measure of separation 
between technical adequacy and 
usefulness so that each can be in- 
dividually assessed, (2) link the two 
components, nonetheless, since 
both are essential in determining 
evaluation quality, and (3) lay the 
foundation for developing a better 
understanding of the critical relation- 
ships between the two components 
(by including, for example, the 
specification of measures of use in 
the managerial review of technical 
adequacy—see table |, |, 1, d). 

In brief, the above discussion of 
evaluation quality argues that (1) it is 
reasonable to define evaluation qual- 
ity as composed of two components, 
technical adequacy and usefulness; 
(2) that there are three factors which 
figure critically in the managerial re- 
view of technical adequacy: (a) the 
appropriateness of the evaluation 
design as a function of the question 
to be answered, the time required, 
and the costs allocated for answer- 
ing it, (b) the appropriateness of the 
evaluation’s execution with respect 
to the design selected and the costs 
and time required, and (c) the ab- 
sence of conceptual errors, inap- 
propriate technical procedures and 
improper conclusions or inferences 
in the design, execution, and report- 
ing of the evaluation; (3) there are 
four factors which figure critically in 
the managerial review of usefulness: 
(a) relevance, (b) timeliness, and (c) 
presentation (all three with respect 
to user need), and (d) impact, or 
evidence of actual use; and (4) pro- 
gress in improving evaluation quality 
can be monitored by using this def- 
inition, these factors, and the mea- 
sures which flow from them in the 
management of evaluations. 

This definition considers design 
not only as a dominant factor in im- 
proving evaluation quality, but also 
as a similarly dominant factor in con- 
trolling costs, in minimizing the time 
required for performance, and in 
tracking the use made of reports. 
Such use of design could naturally 
be expected to expand the repertoire 
of methodologies typically employed 
for answering the evaluative ques- 
tions posed. In the same way, the 
manner in which the component of 
usefulness considers relevance, 
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timeliness, and presentation could 
lead to major changes over time in 
the way findings are organized or 
presented, for example. 


Improving Evaluation 
Quality Over Time 


Evaluation staff need to know 
whether efforts they have made to 
improve their performance have re- 
sulted in something measurably bet- 
ter than before. Evaluation managers 
must also be able to track results to 
account for the productive use of 
evaluation resources. Therefore, one 
major purpose for laying out the def- 
initions and measures discussed 
above is to enable evaluators and 
managers to look back, some years 
hence, and trace the progress they 
have rade. At the Institute for Pro- 
gram Evaluation, our development of 
such a system uses indicators de- 
rived from the definition, factors, and 
measures given here. 

Some of the indicators for tracking 
change are, by now, obvious. Review 
measures for individual evaluations 
have been presented above. With re- 
gard to measuring collective 
changes across a set of evaluations, 
there are many ways in which we ex- 
pect to measure improvement. Five 
of these are illustrated here, using 
the example of a hypothetical 10- 
year comparison period in most 
cases: 


1. Changes in the diversity of prod- 
uct types and methodologies (com- 
parison 1975-1985). 


2. Changes in the average costs and 
time periods for performing jobs 
(1975-1985). 


3. Changes in efficiency as mea- 
sured by product rejections (1983- 
1985). 


4. Changes in response capacity as 
measured by the diversity of report- 
ing formats and improvements in 
timeliness (1975-1985). 


5. Changes in the impact of prod- 
ucts as measured by support to pri- 
mary users (1975-1985). 


The expectation of improvement in 


evaluation quality is, of course, the 
basis for the positive changes de- 
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Illustration 1 
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scribed in these charts. With regard 
to illustration 1, product diversity, it 
would be logical for a new emphasis 
on design appropriateness (relative 
to the question posed and to time 
and cost constraints) to result in an 
increase in product types and meth- 
ods. In the evaluation area, jobs 
could be expected to make use of 
perhaps six methodologies where 
only one or two were used in the 
1970's. 

Illustration 2 shows increased ef- 
fectiveness in terms of time and 
cost; this is reasonable to expect be- 
cause cost and time reductions 


should accompany a diversified ar- 
ray of methods. In many past eval- 
uations, a long, slow, and very costly 
approach has often dominated. In- 
creased diversity is likely to pick up 
quicker, less labor-intensive meth- 
ods. Any increase in design efficien- 
cy, should, on the average, reduce 
costs. 

Illustration 3’s assumption of de- 
creased product rejection derives 
from the belief that new product 
types, methods, and greater rele- 
vance to user needs would generate 
more customer satisfaction and 
hence result in fewer product re- 
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IMustration 3 


Improvements in Efficiency as Measured 
by Product Rejections 





























jections. 

With respect to illustration 4, the 
expectation is that increased sensi- 
tivity to presentation possibilities 
and to timeliness would again in- 
crease user satisfaction. 

Finally, illustration 5 supposes 
that attention to all of these factors 
should result both in greater credi- 
bility and greater impact. 


Illustration 5 


Impact of Evaluation Products as 
Measured by Support to Primary Users 
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reports that impact 
on each category 
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Summary 


This article has developed a defini- 
tion of evaluation quality involving 2 
components, 7 factors, 24 measures, 
and various tracking indicators to 
help evaluation managers account 
for their performance. The definition 
incorporates methodological sound- 
ness and attention to time lags, 
costs, use, and user needs. The mea- 
sures assume a managerial review 
process at the design phase and at 
the end of a job focusing on method- 
ological soundness, cost, and time; 
feedback from field staff with re- 
spect to design implementation; re- 
view of customer satisfaction vis-a- 
vis report relevance, timeliness, and 
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Illustration 4 


Response Capacity as Measured by Different Types 
of Reporting Formats 





19751985 19751985 











Type Type Type Type 
1 2 3 4 
































“Discontinued formats 
Formats developed and implemented in 1980 


Timeliness as Measured by the Frequency 
of On-Time/Behind-Time Deliveries 





ua Nall 





ome "| 
ehind Time | il 

















Q1 Q2 Q3 Q4 
1982 


presentation; and documentation 
and review of the use(s) made of the 
evaluation. 

Hypothetical tracking indicators 
were elaborated based on the formal 
inclusion of such elements as 


e information need (i.e., the ques- 
tion), 
e design, 
time to completion, 
cost, 
feasibility, 
absence of major errors, 
relevance, 
date needed (timeliness), 
presentation, and 


Q1 Q2 Q3 Q4 
1983 





Q1 Q2 Q3 Q4 
1984 


Q1 Q2 Q3 Q4 
1985 


e impact. 


The presumption is that careful man- 
agerial attention over time to these 
elements should result in better eval- 
uation quality, lower costs, greater 
timeliness, increased diversity of 
methods, more customer satisfac- 
tion, and wider impact. 

IPE will begin testing such a sys- 
tem in fiscal year 1983. We expect 
that it will allow us both to track the 
soundness, efficiency, and use- 
fulness of the evaluations we per- 
form and to measure changes in our 
effectiveness over time. 





Linda Weeks 
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GAO’s Executive 
Candidate Development 


Program Is 


Fall 1982 marks the first anniver- 
sary of GAO’s Executive Candidate 
Development Program (ECDP). Mr. 
Socolar, the Acting Comptroller 
General at that time, selected the 
first class of six candidates on Sep- 
tember 10, 1981. A second group of 
seven candidates was selected by 
Comptroller General Bowsher in 
April 1982. During the past several 
months, the candidates, guided and 
directed by the Executive Resources 
Board (ERB), have participated in var- 
ious courses, seminars, workshops, 
and developmental assignments. 


An Overview of the 
Program 


The Executive Candidate Develop- 
ment Program is part of GAO’s man- 
agement development approach. 
Encompassing training and develop- 
mental activities for supervisors, 
managers, and executives, this ap- 
proach arises from a commitment to 
meet both organizational and per- 
sonal needs. The ECDP focuses on 
developing a group of highly quali- 
fied professionals to meet GAO’s 
present and future needs for execu- 
tive-level managers. Figure 1 is a 


1 Year Old 


schematic of the ECDP’s major 
phases and processes. 

Applicants for the ECDP, mana- 
gers from the GS-15 level, must pass 
a rigorous screening and reviewing 
process to become candidates. Divi- 
sion directors and members of the 
Qualifications and Performance Re- 
view Board evaluate and rank these 
applications. The board then sends 
the names of the top 50 percent to 
the ERB for consideration. After 
study, the ERB makes an initial cut, 
interviews the remaining applicants, 
selects the finalists, and sends their 
names to the Comptroller General for 
approval. 


Preliminary Activities 


Upon entering the program, can- 
didates plunge into activities that 
will help them develop strategies to 
address the competencies which are 
the core of the ECDP. The nine com- 
petency areas—leadership, concep- 
tualization, decisionmaking, inter- 
personal skills, oral communication, 
written communication, organization 
and planning, adaptability, and de- 
cisiveness—help define how well an 
executive performs. One of their first 
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activities involves the Developmental 
Diagnostic Center (DDC), which rates 
their performance in each of these 
nine competencies. After the DDC, 
candidates receive counseling and a 
written evaluation report which aid 
their design of Individual Devel- 
opment Plans (IDPs). 

Within 3 weeks of entering the pro- 
gram, they also choose a Senior Ex- 
ecutive Service (SES) staff member 
to serve as their mentor. The ERB re- 
views and approves these choices. 
Candidates should select mentors 
with extensive GAO experience who 
will help them focus career goals in 
the context of organizational needs. 
The senior adviser counsels the can- 
didate in designing the IDP and as- 
sists in locating and arranging 
appropriate developmental assign- 
ments. The mentor also monitors the 
candidate’s performance in the pro- 
gram, provides feedback, and at- 
tends the quarterly ERB review ses- 
sions with the candidate. 

As the framework for the can- 
didate’s experiences in the ECDP, 
the IDP clarifies and provides a con- 
text for the individual’s goals and 
objectives. To develop an IDP, the 
candidate and mentor consider the 
candidate’s experience and career 
objectives as well as information 
about strengths and weaknesses ob- 
tained from past supervisors and the 
DDC profile. Once the ERB approves 
their IDPs, candidates begin training 
and developmental assignments. 

The candidates participate in var- 
ious internal and external activities, 
choosing rotational assignments to 
complement previous experiences. 
Most of the developmental assign- 
ments last from 1 to 6 months and 
have specific objectives. Another 
type of developmental assignment 
involves accompanying an SES staff 
member through routine job ac- 
tivities. These assignments may last 
from 1 week to several months. Can- 
didates may also be scheduled to at- 
tend appropriate external training 
courses in the public or private sec- 
tors or at a university. Attendance 
varies from a 1-week seminar to an 
extended period. 

Besides these activities based on 
the IDP, each candidate also par- 
ticipates in required program com- 
ponents. Upon selection, candidates 
attend seminars given by the Office 
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ment (OOHD) on mentoring and de- 
veloping an IDP. SES mentors attend 
a similar seminar on roles and re- 
sponsibilities. Candidates attend 
workshops on current operations is- 
sues and seminars designed to im- 
prove their performance in the nine 
competency areas. When appropri- 
ate, candidates are also invited to at- 
tend lectures, seminars, or work- 
shops planned for the SES staff 
members. 

During their 18 months in the 
ECDP, candidates are adminis- 
tratively assigned to OOHD. Those 
activities identified in their IDPs 
eventually become the candidates’ 
full-time “jobs.” Although ECDP can- 
didates may apply for SES positions, 
they must still complete the pro- 
gram. 


A Look at the 
Candidates 


The 13 candidates selected during 
fiscal year 1982 come from diverse 
backgrounds and bring a wealth of 
experiences into the program. There 
were two announcements for ap- 
plicants released in 1982. Although 
the announcement for the first class 
was issued Government-wide, all 
those selected have been GAO em- 
ployees. Some have extensive field 
experience, several have had assign- 
ments in staff as well as line units, a 
few have had overseas experiences 
or Capitol Hill assignments, and two 
have had extensive experience out- 
side GAO. 


John Adair was named as a candi- 
date in the first group selected in 
September 1981. He was then the 
deputy associate director in the Ac- 
counting and Financial Management 
Division’s Governmental Internal Au- 
dit/Fraud Prevention Group. William 
Anderson, director of the General 
Government Division (GGD), became 
his mentor. Since John was already 
in the 10-month program at the In- 
dustrial College of the Armed Forces 
(ICAF), his initial involvement in the 
ECDP was limited to the required 
seminars and workshops. Since his 
completion of the ICAF program, he 
has worked with the Reports Task 
Force. Future assignments will take 
him to both civil and defense divi- 
sions. 


Johnny Finch and Dan White were 
the first two candidates in the ECDP 
program selected to fill SES vacan- 
cies. Johnny remained with GGD and 
became associate director of the In- 
ternal Revenue Operations Group. 
Dan, then with the Community and 
Economic Development Division 
(CEDD), became the associate direc- 
tor for the Energy and Minerals Divi- 
sion’s (EMD’s) Nuclear Energy, Elec- 
tric Power, and the Department of 
Energy’s Management Administra- 
tion Group at the Germantown site. 
Given their current responsibilities, 
the ERB extended the time period al- 
lotted for them to complete their IDP 
activities. J. Dexter Peach, director 
of EMD, and Ralph Carlone, Philadel- 
phia regional manager, have been 
working as mentors with Johnny and 


Milton Socolar (standing) was the Acting Comptroller General when the first group of 
ECDP participants was nominated. Left to right: Johnny Finch, Daniel White, John 
of Organization and Human Develop- Adair, Larry Peters, Paul Math, and Joan McCabe. 
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Dan, respectively, to help locate ac- 
tivities to fulfill the needs identified 
in their IDPs. Johnny attended Dart- 


mouth’s Executive Institute this past 
summer. Dan will work with the Phil- 
adelphia regional office and the Of- 
fice of Policy (OP). 

Paul Math, entering the ECDP as 
the senior group director of a Pro- 
curement, Logistics and Readiness 
Division (PLRD) subdivision, has had 
an unusual rotational assignment. 
For 6 months he worked directly for 
the Comptroller General. In targeting 
this assignment, Paul and his men- 
tor, Dick Fogel, director of the Office 
of Program Planning (OPP), had 
thought of finding a senior-level staff 
position, possibly under one of the 
Assistant Comptrollers General. In- 
stead, Paul was invited to work di- 
rectly with Mr. Bowsher. For 6 
months, Paul combined a silent ob- 
server role as Mr. Bowsher met with 
GAO staff, testified before the Con- 
gress, and spoke with people from 
public and private organizations with 
various administrative duties. Paul is 
also working in the Philadelphia re- 
gional office, will work in a head- 
quarters division, and will then at- 
tend a 7-week FEI program. 


Two assistant regional managers 
(ARMs)—Joan McCabe and Larry Pe- 
ters—were in the first class. Joan, 
one of Boston’s ARMs, has had field 
experience with the New York region- 
al office and the International Di- 
vision’s (ID’s) European Branch. 
Larry had been on the staff in both 
the Seattle and Denver regional of- 


fices before his job in San Francisco. 
Both have worked in the Office of 
Program Planning. With her mentor, 
PLRD director Donald Horan, Joan 
arranged a wide variety of assign- 
ments. She had a long-term assign- 
ment working with Ron Lauve in 
GGD’s Law Enforcement and Justice 
Group. For a shorter time, she shad- 
owed Mr. Horan, and for approx- 
imately 4 weeks she concentrated on 
the Office of Congressional Rela- 
tions. She joined Paul Math in help- 
ing OOHD’s training staff design two 
courses for senior GAO staff. 
Through the ECDP, Joan is now a 
full-time graduate student in Har- 
vard’s Mid-Career Masters of Public 
Administration Program. On the west 
coast, Larry and his mentor, Tim Mc- 
Cormick, San Francisco regional 
manager, have arranged internal and 
external developmental assign- 
ments. In February 1982, Larry en- 
rolled in the Program for Senior Ex- 
ecutives at the John F. Kennedy 
School of Government at Harvard. In 
May he began working in Sacramen- 
to with Larry Margolis, Executive 
Secretary for the California Debt Ad- 
visory Commission. 


The Second Group 


The second class of candidates 
had selected their mentors, par- 
ticipated in one operations work- 
shop, and submitted their IDPs by 
late May. Their IDPs have been re- 
viewed by the ERB, and they are now 
beginning their assignments. A re- 


view of the IDPs reveals the variety of 
education and developmental as- 
signments being requested. Some 
seek to broaden their understanding 
of regional operations by joining 
Field Operations Division (FOD) pro- 
jects, while others hope to expand 
their perspectives by working in 
other Federal agencies, local govern- 
ment, or one of the ‘big eight” firms. 

Dave Baine, the Human Resources 


Division’s deputy associate director 
for the Social Services and Health 
Research, Resources, and Services 
Group, had already been accepted in- 
to Harvard University’s Program for 
Senior Executive Fellows and is pres- 
ently fulfilling this assignment after 
completing an FOD project. 

Steve Virbick joined Dave Baine on 
the FOD project in June 1982 and is 
presently working on an assignment 
with the International Division. Steve 
had been a group director with 


GGD’s Financial Institution Regu- 
latory Group. 

PLRD’s Marty Ferber, like John 
Adair, was already enrolled in ICAF 
when he was chosen. After complet- 
ing his studies, he was assigned as 
an assistant in the Comptroller Gen- 
eral’s office. 

Mike Gryszkowiec, who has 
worked in CEDD, GGD, EMD, and 
OPP, was a member of the Personnel 
Systems Development Project task 
force before his acceptance. Mike 
expects to work with FOD and OP 
and is arranging an assignment with 
the Office of Management and Bud- 
get. 


The second group of candidates posed with Messrs. Bowsher and Socolar. Left to right: John Vialet, Rich Davis, Martin Ferber, 
Michael Gryszkowiec, John Luke, Steven Virbick, and David Baine. 
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Rich Davis, assistant to the direc- 


tor of OPP, had previously attended 
the National Defense University and 
the Harvard Program for Senior Exec- 
utive Fellows. Among his IDP activ- 
ities, Rich is arranging an assign- 
ment at a State or county govern- 
ment and an executive agency. Addi- 
tionally, he will attend the Office of 
Personnel Management’s LEGIS Fel- 
lows Program. 

John Luke, from the Program 
Analysis Division, and CEDD’s John 
Vialet bring to the candidate pro- 
gram expertise as GAO evaluators as 
well as consulting experience. John 
Vialet has served on the Reports 
Task Force and is arranging other as- 
signments with line and FOD units. 
John Luke is completing an assign- 
ment in FOD and plans additional 
jobs in headquarters divisions and 
offices as well as in regional offices. 
Additionally, he will be seeking ex- 
perience outside GAO—perhaps with 
a White House task force or an ex- 
ecutive agency inspector general 
group. 


Highlights from the 
First Year 


Most candidates praise the ECDP 
for being a full-time program which 
lets them participate in a broad 
range of activities. According to 
Johnny Finch, most developmental 
assignments become so task ori- 
ented that their developmental pur- 
pose is obscured. In contrast, the 
ECDP allows participants to pursue 
product-centered assignments while 
meeting their developmental needs. 
One new candidate, Mike Gryszko- 
wiec, expects the ECDP will help par- 
ticipants break with past roles and 
give them the experiences necessary 
to develop a broader agency per- 
spective. In completing his IDP, Paul 
Math observed that the ECDP pro- 
vided opportunities to work in areas 
or on assignments previously un- 
available because of ongoing job re- 
sponsibilities. 

The candidates also agree that the 
mentor/candidate relationship was 
important to their first-year ex- 
periences. Mentors helped them as- 
sess the gaps in their experiences. 
Through contacts within and outside 
GAO, mentors could identify assign- 
ments to round out the candidates’ 
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GAO’s Executive Candidate Development Program Is 1 Year Old 





Dr. Harry Levinson was the instructor for two ECDP workshops. He is the President of 
the Levinson Institute and a professor at Harvard University. 


development. Candidates generally 
believed that the mentors were cru- 
cial in helping them focus assign- 
ments into activities which bene- 
fitted both the individual and GAO. 
For many candidates, the high 
point of the required workshops were 
the presentations by and discus- 
sions with Dr. Harry Levinson. This 
noted author, Harvard lecturer, and 
President of the Levinson Institute 
met with the candidates at two work- 
shops. The first workshop, designed 
to examine human resource manage- 
ment within GAO, analyzed the roles 
and responsibilities of managers and 
executives in human resource man- 
agement. In the second workshop, 
Dr. Levinson considered the psy- 
chological impact of organizational 
change upon individuals. He then ex- 
plored what managers and exec- 
utives can do to prevent or relieve 


some of its side effects. 

The Executive Candidate Develop- 
ment Program requires a serious in- 
vestment of time and energy by par- 
ticipants. They must be committed to 
developing their professional and 
personal skills to the fullest. The 
ECDP also requires cooperation and 
support from senior managers 
throughout the agency. First-year 
participants have enjoyed a variety 
of training and developmental ex- 
periences provided by divisions, re- 
gions, and offices. They have met 
regularly with the Executive Re- 
sources Board to ensure that their 
development plans are on target. At 
the end of its first year, the ECDP is 
running smoothly and moving steadi- 
ly toward its goal of providing a sys- 
tem that satisfies the needs of both 
organization and staff. 
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Understanding 
Intergovernmental 
Relations 


By Deil S. Wright, second edi- 
tion, Brooks/Cole Publishing 
Co., Monterey, California, 1982. 
532 pp. 


Trying to explain intergovernmen- 
tal relations and how it works is 
much like the proverbial description 
of an elephant by a group of blind 
men. Too often, observers of inter- 
governmental relations (IGR) de- 
scribe only the viewpoint of one blind 
man without explaining that other 
perceptions exist. As a result, any- 
one trying to understand IGR quickly 
becomes confused after reading sev- 
eral disparate descriptions. 

IGR is inherently a sprawling and 
unsystematic topic, and for many, in- 
penetrable. This confusion occurs 
because IGR cuts across such dis- 
ciplines as law, economics, political 
science, and public administration, 
and few authors provide a balanced 
view of these divergent approaches. 
Professor Wright understands this 
Rubik’s Cube and has all colors fac- 
ing the right direction in his second 
edition of Understanding Intergov- 
ernmental Relations. 

Dr. Wright gives IGR a broader 
scope than the concept of federal- 
ism. Federalism, he says, historically 


emphasizes national-State relation- 
ships, implying a hierarchy of power 
relationships. IGR, however, con- 
tains no hierarchical distinctions 
and is based on a wide range of infor- 
mal actions and perceptions by of- 
ficials at all levels. From this prem- 
ise, he develops several theoretical 
models of how IGR might be per- 
ceived by intergovernmental par- 
ticipants and illustrates these 
models with clear examples. In il- 
lustrating his overlapping authority 
model, he quotes a mayor who ob- 
served, in dealing with Federal agen- 
cies, “I feel like I’m the United Fund 
chairman calling on potential 
givers.” Such observations readily 
define relationships better than any 
academic prose. 

This spectrum of definitions of 
IGR, supported by real-life examples, 
helps the reader understand that dif- 
ferent people mean different things 
when talking about the same sub- 
ject. No single perspective is nec- 
essarily the “correct” answer since 
each has some validity. 

After briefly reviewing both IGR’s 
historical evolution and trends in 
State and local finances, the book 
then describes IGR’s practical opera- 
tion. Most of the book untangles the 
informal bargaining processes of 
IGR between national, State, and lo- 
cal actors. By synthesizing hundreds 
of examples and dozens of recent 
studies, Dr. Wright masterfully por- 


trays the constraints and capacities 
of various intergovernmental actors 
from several viewpoints without pas- 
sing judgment. For instance, in dis- 
cussing congressional actors, he 
comments on GAO’s capacities. 
Based on other recent analyses, he 
concludes, “The GAO tends to sup- 
port greater national and congres- 
sional control when it specifically ad- 
dresses IGR issues.” He does not, 
however, imply whether this is good 
or bad. 

The strength of this book rests in 
its being descriptive, not prescrip- 
tive. The book describes the dynam- 
ics of what motivates policy actions, 
not the administrative process 
(which continually changes). Syn- 
thesizing major research studies by 
various government and public in- 
terest organizations, he offers poten- 
tial options but does not predict 
IGR’s future. 

Its weakness lies in its inability to 
keep up with this rapidly changing 
field. The book’s detailed elabora- 
tions of Federal policies, such as the 
general revenue sharing program, 
were instantly eclipsed in impor- 
tance by President Rona!d Reagan’s 
New Federalism proposals an- 
nounced in January 1982. These pro- 
posals were of such importance that 
even if none are acted upon, IGR‘s 
political framework has altered 
significantly. And one cannot fully 
understand IGR without analyzing 
them. Given that caveat, the second 
edition of Understanding Intergov- 
ernmental Relations remains rele- 
vant because it centers on the con- 
stant bargaining process of officials 
at all levels of government. And that 
process, according to Dr. Wright, is 
the heart of intergovernmental rela- 
tions. 

Readers of the first edition (pub- 
lished in 1978) will note substantial 
changes. The role of national actors 
is greatly expanded. There is less 
emphasis on finances, and three new 
chapters have been included. One is 
on political parties, interest groups, 
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Legislative 
Developments 

















Federal Courts 
Improvement Act of 


1982 


The Federal Courts Improvement 
Act of 1982 (Public Law 97-164, April 
2, 1982, 96 Stat. 25) amends two sec- 
tions of title 28 of the United States 
Code pertaining to GAO. 

The language of 28 U.S.C. 2510 is 
revised with respect to Compiroller 
General referral to the United States 
Claims Court for trial and adjudica- 
tion of any claim or matter on which 
the Claims Court might take jurisdic- 
tion on the voluntary action of the 
claimant. 

The law also amends 28 U.S.C. 
2516(b), pertaining to interest on 
claims and judgments. Interest on 
judgments against the United States 
affirmed by the Supreme Court, after 
review on petition of the United 
States, is to be paid from the date of 
filing the judgment transcript in the 


General Accounting Office to the 
date of the mandaie of the affirm- 
ance, at a rate of interest equal to the 
coupon issue yield equivalent to the 
average accepted auction price for 
the last auction of 52-week U.S. 
Treasury bills settled immediately 
prior to the date of judgment. 


Olympic Coins 


Controversy arose in this session 
of Congress over coins to commem- 
orate the 1984 Olympic Games in Los 
Angeles. 

On April 27, congressman Frank 
Annunzio of Illinois discussed the 
situation while describing the provi- 
sions of H.R. 6158, which he had in- 
troduced the previous day: 

***The Olympic Commemorative 
Coin Act goes to great lengths to pro- 
tect the taxpayer from any costs in 
this program. My bill is the only bill 
that meets the General Accounting 
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Office criteria for sales of these 
coins. The Senate Olympic coin bill 
(S. 1230) would cost the taxpayer up 
to $360 million in indirect Federal fi- 
nancing. Mr. St. Germain’s bill (H.R. 
6058), according to the General Ac- 
counting Office, would cost the Gov- 
ernment up to $210 million in fore- 
gone revenues. The supporters of 
these other proposals can call these 
numbers what they will, but they can- 
not change the fact that under those 
bills the taxpayer is indirectly financ- 
ing the Olympics. 

Not only does my bill meet the 
General Accounting Office objec- 
tions, but my bill specifically directs 
the Secretary of the Treasury to take 
all actions necessary to assure that 
the coin program will not cost the 
taxpayer one penny.***' 


On May 20, the House passed a 
modified Annunzio substitute for S. 
1230 which includes a provision for 
GAO audit of records of the U.S. 
Olympic Committee and the Los An- 
geles Olympic Organizing Commit- 
tee relating to expenditures of 
amounts paid from proceeds of the 
sale of the coins. Earlier, on Decem- 
ber 9, 1981, the Senate passed a dif- 
ferent version of $.1230. 


DOD Authorization 
for Fiscal Year 1983 


On May 13, the Senate passed 
S. 2248, the Department of Defense 
Authorization Act, 1983. The bill was 
amended to provide for the establish- 
ment of an Office of Inspector Gener- 
al for the Department of Defense. 
Among other duties, the Inspector 
General is to develop policy, evaluate 
program performance, and monitor 
actions taken by all components of 
the Department in response to con- 
tract audits, internal audits, internal 
review reports, and audits conducted 
by the Comptroller General. 

The measure requires the Comp- 
troller General to review and analyze 
reports or certifications on unit costs 
of major defense systems by the 
Secretary concerned and report to 
the Committees on Armed Services 
of the Senate and House of Rep- 
resentatives. The act delineates the 
contents of the analysis to be made. 


Waste and Abuse 
Information 
Collection Act 


H.R. 6266, Waste and Abuse Infor- 
mation Collection Act, introduced by 
Congressman Thomas E. Petri of 
Wisconsin, provides for the opera- 
tion of facilities for the collection of 
information concerning fraud, waste, 
or abuse in the expenditure of Fed- 
eral funds. 

The bill provides that the head of a 
Federal agency may pay a cash 
award to any individual whose dis- 
closure of fraud, waste, or abuse to 
the agency has resulted in cost sav- 
ings. 

Documentation substantiating 
any award is to be submitted to the 
Comptroller General. From time to 
time, the Comptroller General is to 
review awards made and procedures 
used to verify the cost savings. 


Competition in 
Contracting Act 


On May 4, in a discussion of 
S. 2127, Competition in Contracting 
Act, Senator William S. Cohen of 
Maine referred to the GAO report, 
“Less Sole-Source, More Competi- 
tion Needed on Federal Civil Agen- 
cies’ Contracting’ (PLRD-82-40, 
Apr. 7, 1982), summarized its recom- 
mendations for improving competi- 
tion in Government contracting, and 
pointed out that these recommenda- 
tions are included in the provisions 
of the bill. 


Food Stamp Act 
Amendments of 1982 


On April 1, the Food Stamp 
Amendments of 1982, S. 2352, was 
introduced by Senator Jesse Helms 
of North Carolina. Title XIlIl—State 
Block Grant Option—provides for 
certain design flexibility with respect 
to the operation of a low-income nu- 
tritional assistance block grant pro- 
gram to finance expenditures for 
food assistance for needy persons 
within the State. 

The Comptroller General is to eval- 
uate expenditures by block grant 
States to assure that expenditures 
are consistent with the law and to 
determine the effectiveness of the 


block grant State in accomplishing 
the purpose of the law. 

The Comptroller General may also 
conduct investigations of the use of 
the funds. 

The Secretary of Health and Hu- 
man Services, in consultation with 
the Comptroller General, is to eval- 
uate possible formulas for allotment 
of funds which could be used as al- 
ternates to those described. 


Civil Process Fees 


On May 27, Senator Max Baucus 
of Montana introduced S. 2588, to 
provide for the setting of fees in the 
service of civil process. 

While introducing the measure, 
Senator Baucus referred to a recent 
GAO report entitled, “U.S. Marshals 
Can Serve Civil Process and Trans- 
port Prisoners More Efficiently” 
(GGD-82-8, Apr. 22, 1982), which 
recommended the legislation. 

Senator Baucus noted: 

***GAO found that the fees 

charged by the U.S. marshals for 

serving civil process for private 
litigants have not changed sig- 
nificantly in over 180 years.***? 





‘Cong. Rec., Vol. 128 (April 27, 1982), p. 
H1622-23. 

2Cong. Rec., Vol. 128 (May 27, 1982), p. 
$6375. 
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Ten years ago, in the Fall 1972 is- 
sue of the GAO Review and fall edi- 
tions of the Watchdog, you will find 
that 


e The first edition of the “Stan- 
dards for the Audit of Governmental 
Organizations, Programs, Activities, 
and Functions” was formally issued 
by Comptroller General Elmer B. 
Staats on August 1, 1972. The Gen- 
eral Accounting Office completed 
the project with the assistance of 
representatives of Federal agencies, 
State and local governments, leading 
professional organizations, public in- 
terest groups, and the academic 
community. On August 1, 1972, a 
public briefing on the new standards 
was conducted in the GAO Building 
by the Comptroller General and Don- 
ald L. Scantlebury, director, Fi- 
nancial and General Management 
Studies Division. The briefing was at- 
tended by about 100 representatives 
of Federal agencies, professional as- 
sociations, State and local govern- 
mental organizations, and the press. 
(NOTE: During the late spring of 
1981, GAO released a second revi- 
sion of the original audit standards 


issued in 1972. The standards have 
since been translated into Spanish, 
and France is currently finalizing a 
French version.) 

e The Manila office of the Far 
East Branch, International Division, 
closed June 30, 1972, and the func- 
tions, duties, and several staff mem- 
bers were transferred to Bangkok, 
Thailand, effective July 1. Fred E. 
Lyons was designated manager. 

e Martin J. Fitzgerald, director, Of- 
fice of Congressional Relations, was 
designated attorney-adviser for leg- 
islation in the Office of Legislative 
Liaison, Office of the Comptroller 
General, effective July 9, 1972. 

e Robert M. Gilroy, senior asso- 
ciate director, Procurement, Log- 
istics and Readiness Division, was 
designated assistant director in the 
Office of Internal Review, effective 
July 9, 1972. 

¢ Daniel P. Leary, director, Office 
of Internal Review, was designated 
assistant manager in the Washing- 
ton regional office, effective July 10, 
1972. 

e Alexander A. Silva, director, 
Civil Rights Office, was appointed 
deputy director for Equal Employ- 





Reflections 


ment Opportunity of the General 
Accounting Office. This newly estab 
lished full-time position was an 
nounced by Comptroller General 
Elmer B. Staats in October 1972. 

e Marvin Colbs was appointed 
manager of the Atlanta regional of- 
fice, effective August 28, 1972. 

© Clifford |. Gould, director, Feder- 
al Personnel and Compensation Divi- 
sion, was designated an associate 


director in that division with respon- 
sibility for Government-wide reviews 
of Federal compensation and the ac- 
quisition, utilization, and retention of 
Federal personnel, effective July 23, 
1972. 

e Frank Borkovic, assistant mana- 
ger, Dallas, was designated manager 
of the International Division’s Saigon 
office, Far East Branch, effective 
August 20, 1972. 


e Donald E. Day, senior associate 
director, Mission Analysis and Sys- 
tems Acquisition Division, was des- 
ignated assistant director in the Pro- 
curement and Systems Acquisition 
Division, effective July 9, 1972. 


Twenty years ago, in a fall issue of 
the Watchdog, the following picture 
was published of the Second GS-7 
Training Program for 1962. 


THE SECOND GS-7 TRAINING PROGRAM FOR THE YEAR 1962 GIVEN BY THE OF- 
FICE OF STAFF MANAGEMENT was conducted in Washington, D.C., July 9 
through 20. °eading from left, ROW 1: John F. Elliott, Philadelphia Regional Office, 
Counselor; David Rettiger, Kansas City Regional Office, Counselor; Leo Herbert, 
Director, Office of Staff Management; Joseph Campbell, Comptroller General of the 
United States; Edward Breen, Assistant Director, Office of Staff Management; 
Cornelius Tierney, Boston Regional Office, Counselor; James Kelly, Civil Account- 
ing and Auditing Division, Counselor. ROW 2: Joann H. Olson, Speight W. Burrus, 
Jack H. Vital, Judith A. Howe. ROW 3: Davis S. Shupe, L. Thomas Snyder, Richard L. 
Maynard, Archie Granda, William Hill, Robert Procaccini, Robert W. Jones, James 
S. Whitt, Jr., Joseph T. Valonis, Fred C. Conant, Robert R. Lindemuth, Charles H. 
Wehring. ROW 4: Ken Earnest, Jerry Lininger, John Navarre, Jerry Brenner, Larry 
Kortick, William C. Lynch, Charles V. Carroll, 


William B. Diepenbrock, Donald C. Hahn, Joel R. Berman, Robert E. Pavlik, Robert 
A. Indresano. ROW 5: James M. Mathews, Francis K. Boland, Larry J. Simon, Victor 
L. Wells, Jr., Arthur L. Hale, Ramon A. Looney, John A. Remke, Ben F. Gardner, 
Robert Clark, Vern F. Amick, Matthew R. Solomon, Joe E. Totten. ROW 6: J.F. 
Sparks, J.L. Magnes, L.R. Drewett, F.E. Harzer, J.K. Seidlinger, R.D. Robertson, S. 
Krywucki, J.P. Kelly, S. Correira, Jr., G. R. Demers, R.D. Gerring, J.R. Tipton. ROW 7: 
Robert Farabaugh, Leonard Burns, Earl Ellison, Brian Crowley, Orian A. 
Archambault, Donald H. Leppla, Larry C. Hanna, Gene W. Mindling, A. Herman 
Meyer, Jr., Billy R. Gilliland, Joseph S. Azzarano, Walter Smith. ROW 8: Ralph E. 
Anderson, James B. Perkins, Michael D. Pecovish, Harold D. Edwards, Kermit S. 
Mohn, Leo Ganster, Thomas J. Kingfield, David E. Overman, Jr., Donald E. Whit- 
teaker, Gerald H. Springborn, Emil C. Cracker, Cecil B. Carter. 
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tute. President Reagan dropped the 
U.S. Circuit Judge Nominating Com- 
mission and the Statistical Policy 
Coordination Committee but created 
the Cabinet Council on Human Re- 
sources, the Task Force on Legal 
Equality on Women, and the National 
Commission on Social Security Re- 
form. The full list contains over 50 
groups; auditors may find some use- 
ful information sources therein. Fora 
complete listing of both the created 
and abolished offices, call the 
Federal Register on (202) 523-5240. 


“Auditing by Mail’’ 
Gets Good Response 


Editor’s Note: The Review article, ‘‘Auditing 
by Wire: Shocking Results’ (Winter 1982), 
aroused the interest of two GAO evaluators 
in the Kansas City regional office. Their re- 
cent audit experience indicated that a good 
response rate to questionnaire surveys can 
also be obtained using the regular mails if the 
respondent has a special interest in the infor- 
mation being obtained. Dulcy Sellon and 
John Schaefer agreed with the Review 
authors that mailgrams are effective 
attention-getters and may improve response 
rates in many situations. They wrote: 


“During a recent assignment we 
confirmed the inventory of Commodi- 
ty Credit Corporation-owned com- 
modities held by commercial ware- 
houses located in 27 states. We 
asked warehousemen to verify a list 
of warehouse receipts identified by 
quantity and quality factors. For 
some of the warehouses the list of 
inventory receipts extended to over 
100 pages of computer printouts. 

“We included a return envelope 
and asked the warehousemen to veri- 
fy the inventory and return the entire 
computer listing to us. Within 14 
work days, we had received 147 re- 
sponses, for a response rate of 92 
percent. We sent second-request let- 
ters after 3 weeks. In the end, after 28 
working days from the mailing of the 
original requrest, we received re- 
sponses from 158 of the 160 ware- 
houses sampled, a- 98.7 percent 
response rate. 

“We believe this rapid and exten- 
sive response rate resulted from the 
warehousemen’s interest in assuring 
that their inventory records agreed 
with those held by Commodity Credit 
Corporation. The warehousemen 
have an obvious interest in assuring 
correctness because they receive 
fees for the storage of government 


commodities. 

“The results of our survey work 
suggest that a specific population 
with an interest in the survey will be 
prompted to respond rapidly. Thus 
we suggest that auditors consider 
the interest, financial or other, the 
Surveyed population has in the 
questionnaire before deciding on 
the type of survey techniques to 
use.” 


Block Grant Reports 
Available 


The Summer 1982 “Briefcase” 
article entitled “GAO and Block 
Grants” described two major prod- 
ucts. One was the GGD-led study 
addressing early implementation of 
block grants in 13 States and the 
other was an IPE-led synthesis of 
evaluations of the five original block 
grants passed in the previous 
decade. These reports are now avail- 
able from GAO Documents Distribu- 
tion, room 1518, (202) 275-6241. Ask 
for “Early Observations on Block 
Grant Implementation,” GAO/GGD- 
82-79, Aug. 24, 1982, and “Lessons 
Learned from Past Block Grants: Im- 
plications for Congressional Over- 
sight,” GAO/IPE-82-8, Sept. 23, 1982. 





TOPICS, Cont. from p. 12 


Huff, D. How to Lie with Statistics. 
New York: W.W. Norton, 1954. 


Despite the irreverent title, a good 
guide to avoiding some misuses of 
Statistics. 


Nie, N.H., et al. SPSS, Second Edi- 
tion. New York: McGraw-Hill, 1975. 


Good descriptions of statistical 
techniques plus instructions on how 
to use the SPSS programs. Also see 
SPSS, Update 7-9 published in 1981. 


Ostle, B. and Mensing, R. Statis- 
tics in Research: Third Edition. 
Ames, lowa: lowa State University 
Press, 1975. 


One of many books on traditional 
statistical techniques. 





See TOPICS, p.58 
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SOME STATISTICAL TOOLS FOR EVALUATION 





Data 
Analysis 
Kind Mode Descriptive Statistics 


Inferental Statistics 
Exploratory Data 





of 
Information 


Point and Interval 
Estimates 


Analysis Techniques 
Test Statistics 








Tendency 


Mode 


Central Sample Mean 


t-statistic Median 


Tnmmed-mean 


Winsonzed mean 





Dispersion Standard deviation 
Variance 


Range 


Sample standard 
deviation 


Chi-square statistic Midspread 
Box-and- whisker plot 


Stem-and-leat display 





Frequencies 


Proportions 


Sample proportions 


Chi-square statistic 


Stem-and-leat display 





Association between 
two variables 


Correlation coefficient 


Regression coefficient 


Two-way contingency 
table 


Sample correlation 
coefficient 


Sample regression 
coetficient 


Two-way table of 
sample data 


Fisher's Z 


t-statistic 


Chi-square statistic 


Scatter plot 


Tukey line 








Comparison between 
groups 





Difference between 
means 
standard deviations 
adjusted means 


rank ordered cases 


frequency distribution 
of categorical variables 





Difference between 


adjusted sample 
means 

rank ordered sample 
cases 

sample frequency 
distribution 





F- statistic 


Mann-Whitney 
U- statistic 
Chi-square statistic 





Stem-and- leat display 
Box-and- whisker plot 
Re- expression 


Analysis of residuals 











TOPICS, Cont. from p. 57 


Porter, A.L., et al. “Misleading In- 
dicators: The Limitations of Multiple 
Linear Regression in Formulations of 
Policy Recommendations.” Policy 
Sciences, 13, (1981), 397-418. 


A close examination of the use of 
regression analysis in a variety of 
situations. 


Tukey, J.W. Exploratory Data Anal- 
ysis. Reading, Massachusetts: Ad- 
dison-Wesley, 1977. 


A large collection of techniques 
from one of the chief advocates for 
EDA. 





MANAGER'S, Cont. from p. 14 


Journal of Applied Psychology, 67, 
No. 2 (April 1982), 181-188. 

Lippitt, Gordon and Ronald Lippitt. 
“ ‘Downsizing’—How To Manage 
More With Less.” Management 
Review, 61, No. 3 (March 3, 1982), 
9-14. 

Magid, Renee Y. “Parents and Em- 
ployees: New Partners in Child 
Care.” Management Review, 71, 
No. 3 (March 1982), 38-44. 

Mahoney, Francis X. “‘Team Develop- 
ment Part 5: Procedure Meetings.” 
Personnel, 59, No. 3 (May-June 
1982), 30-41. 

McGarrah, Robert E. “Productivity: II- 
lusions and Realities.” Manage- 
ment World, 11, No. 5 (May 1982), 
8-11. 

Meyer, John H. and Teresa C. Meyer. 
“The Supervisor as Counselor— 
How To Help the Distressed Em- 
ployee.” Management Review, 71, 
No. 4 (April 1982), 42-46. 


Ohmae, Kenichi. “See the Options 
Before Planning Strategy.”’ 
Management Review, 71, No. 5 
(May 1982), 46-55. 

Prevatt, Lena B. ‘The Emerging Field 
of Human Resources Manage- 
ment.” Personnel Administration, 
27, No. 5 (May 1982), 81-87. 

Purvis, Arthur J., “The Lone Ranger 
Syndrome: (Helping Supervisors to 
Ask for Help).” Management, 3, 
No. 1 (Winter 1982), 9-11. 

Rummiler, Geary and Alan Brache. 
“Quality, Productivity Are the Real 
Targets.” Government Executive, 
14, No. 1 January 1982), 24-26. 

Trotter, Richard, Susan Rawson 
Zacur, and Wallace Gatewood. 
“The Pregnancy Disability Amend- 
ment: What the Law Provides.” 
Part |. Personnel Administration, 
27, No. 2 (February 1982), 47-54. 

, “The Pregnancy Disability 
Amendment: What the Law Pro- 
vides.” Part Il. Personnel Ad- 
ministration, 27, No. 3 (March 
1982), 55-58. 





NUCLEAR, Cont. from p. 19 


strategy for existing and future stra- 
tegic weapons. This report indicated 
that because we can no longer pre- 
dict the conditions under which nu- 
clear weapons may have to be used, 
weapons systems should be as- 
sessed according to general perfor- 
mance capabilities, not specific ap- 
plication to a restrictive scenario. 

Some of the nuclear force charac- 
teristics needed today are the same 
as those needed under previous de- 
terrent strategies. For example, the 
ability to survive an attack and, once 
launched, a high probability of 
reaching the target have historically 
been important requirements. These 
Capabilities are even more important 
today because escalation control 
may depend on how secure our 
forces appear and how vulnerable an 
adversary feels. Any enemy doubts 
about U.S. capability in either area 
could weaken our deterrence and in- 
crease the risk of escalation. 

Other characteristics of nuclear 
forces need improvement to meet the 
demands of countervailing strategy. 
For example, to specifically tailor 
and quickly execute a response pre- 
supposes the ability to rapidly re- 
direct our forces to appropriate tar- 


58 


gets. Similarly, the ability to attack or 
threaten high-value targets will de- 
mand greater accuracy. 

Finally, two new requirements are 
essential to make our current deter- 
rence credible. We need to (1) main- 
tain high-alert for weeks or months 
after an attack and (2) retain endur- 
ing, flexible command and control of 
our nuclear forces, even after a nu- 
clear attack. While these capabilities 
are present in existing forces to 
some extent, their presence is more 
fortuitous than calculated. The de- 
sign of future systems, however, 
must maximize these charac- 
teristics. 

The requirement for long-term en- 
durance is perhaps the most funda- 
mental and far-reaching change in 
force requirements. To carry out pre- 
planned attacks, strategic forces 
needed only to survive a first strike 
and then quickly execute the pre- 
planned option. Countervailing stra- 
tegy, however, assumes that much 
longer periods of high-alert could be 
necessary, even after nuclear ex- 
change. 

A conventional conflict might also 
keep nuclear forces on high-alert 
status for weeks or months. This 
would strain the endurance of both 
U.S. and Soviet strategic forces. If 


our capability declined more severely 
than the Soviet’s, the lack of endur- 
ance could prompt an attack or re- 
quire capitulation. If a nuclear war 
has already begun, escalation con- 
trol could depend on the ability of 
surviving strategic systems to oper- 
ate effectively amid nuclear ex- 
changes and lengthy periods of high- 
alert status. 


Epilogue 


Current U.S. initiatives to moder- 
nize our nuclear arsenal have en- 
livened the 37-year-old debate on nu- 
clear warfare. The debate focuses 
not on its desirability but on the best 
means of prevention. The fundamen- 
tal tension between the long-term 
risks of a continued nuclear arms 
race and the short-term needs of nu- 
clear deterrence is no closer to reso- 
lution today than it was in 1945. 

At the beginning of this article we 
pointed out that nuclear deterrence 
grows ever more complicated. Other 
approaches to preventing nuclear 
war have been proposed. Among 
these are the movement supporting a 
freeze on nuclear weapons at current 
levels, efforts to achieve global re- 
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NUCLEAR, Cont. from p. 58 


ductions in nuclear weapons, and 
the view of some that the western 
world should foreswear the first use 
of nuclear weapons. 

Each of the many alternative ap- 
proaches to avoiding nuclear war 
presents a different set of risks and 
challenges to human reason. All, 
however, require an understanding of 
how we got to where we are today. 





BUDGET, Cont. from p. 23 


Conclusion 


Processes and systems matter 
only because they help people do 
what those people already want to 
do. And reform of these processes 
and structures can work only if the 
people involved share the goals of 
the reform. Process changes, of 


course, cannot create that commit- 
ment. Rather, they can only create 
mechanisms for translating that 
commitment into efficient and 
systematic action. 

Notwithstanding this reservation, | 
think we will look back on the 1980’s 
as a lively period for the budget. Pol- 
icy attention will continue to focus 
on the budget. And this focus will in- 
clude not just budget policy, but the 
processes and systems that formu- 
late and execute it. 





BUREAUCRATIC, Cont. from p. 32 


in getting a project started is the 
resistance that can emerge during 
formal study approval. Formal ap- 
proval is especially troublesome for 
projects which are designed to probe 
highly sensitive subject areas. In 
these instances, understanding why 
the subject is sensitive, who views it 
as sensitive, and who will likely be 
the winners and the losers, will re- 
duce the chances of having the pro- 
ject disapproved. 

Even with an understanding of the 
reasons behind the sensitivity of the 
issue, there is still the difficult deci- 
sion of what force and resources to 
use if the study is resisted. Decisions 
in this area depend on how important 
the issue is, whether it can wait for 
another day, and what are one’s per- 
sonal and professional values about 
the analyst’s proper role. 

Keeping a project afloat after ap- 
proval can depend on a similar host 
of decisions, maneuvers, and per- 
spectives. Often the analyst has the 
choice between an open approach, in 
which outside involvement, outside 


support, and a constant flow of infor- 
mation is maintained, and a closed 
approach, in which few outside con- 
tacts are made. With the closed 
route, there must be a legal prece- 
dent and a strong logic for limiting 
access. All too often the bureaucrat- 
ic environment predisposes the eval- 
uator to closed communications dur- 
ing the analysis stage of the process. 
Such closure, while providing protec- 
tion and continuity, also narrows the 
perspectives and interests that go in- 
to a study. At a minimum, a passive 
announcement of the effort and de- 
sign underway can bring valuable in- 
put from other interested parties. 
The resistance encountered in get- 
ting a project approved and keeping 
it afloat reemerges when the eval- 
uator tries to get the project used in 
the policy area. Indeed, much of the 
literature in program evaluation is a 
lament over the poor utilization of 
evaluation studies. Part of this prob- 
lem can be overcome by effectively 
addressing the everyday obstacles 
of the bureaucracy, such as meeting 
deadlines, understanding the issues, 
and uncovering the appropriate data. 


Reports which focus on relevant is- 
sues, support the analysis with credi- 
ble data, and deliver the results ina 
timely fashion can overcome many 
of the barriers in getting evaluation 
reports used. 


Conclusions 


Bureaucratic organizations, while 
not always hospitable to evaluation 
techniques, can be the terrain for 
significant analytical contributions 
to policymaking. Important to achiev- 
ing this is knowledge of the organiza- 
tion and careful cultivation of its 
resources. The knowledge compo- 
nent cannot stand alone, however, 
because insight into the organization 
in and by itself is likely to produce 
only anecdotal and fragmentary in- 
formation. The integration of both 
organizational and program knowl- 
edge with sound analytical tech- 
nology is necessary to the comple- 
tion of the evaluation circle. 
Together, these can produce a time- 
ly, relevant, and reliable analysis. 





EUROPEAN, Cont. from p. 40 


load, though not as diversified as 
most regions, gives us unique oppor- 
tunities to travel and contribute to 
GAO’s goals. 

The European Branch is a close- 
knit family of people who live, play, 
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and work together as a team. We 
strive for excellence in our work and 
in our staff.” 


We're Unofficial 
Ambassadors 


Naturally, as Americans, we are 
rather conspicuous wherever we go. 
And we’re looked upon by the Ger- 
man people as prime examples of 
the American way of life. Our very 
presence here automatically places 
us in the role of unofficial am- 


bassadors of the United States. 
We've found that good relations be- 
tween Germans and Americans re- 
quire only a sincere desire to under- 
stand one another, plus a willingness 
to accept one another as friendly hu- 
man beings with valid and time- 
honored reasons for being different. 





BOOKMARK, Cont. from p. 52 


and administrative agencies at the 
national level, the second treats rela- 
tions between States, and the third 
focuses on State-local relations. Up- 
dated reference notes at the end of 


each chapter lead readers to current 
research and information sources. 
By increasing examples, charts, fig- 
ures, and diagrams, the present text 
is much more readable than the 
earlier edition. 


All in all, Understanding Intergov- 


ernmental Relations is a superb 
primer. This second edition shows 
that it remains an important contri- 


bution to understanding how and 
why over 38,000 units of government 
manage to get along in our Federal 
system. 


John M. Kamensky 
Program Analysis Division 
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GAO Staff Changes 


As we are going to press, Comp- 
troller General Bowsher announced 
several organizational changes 
within GAO and especially within the 
Office of the Comptroller General 
itself. Henry Eschwege will be Assis- 





tant Comptroller for Planning and 
Reporting, Frank Fee will be Assis- 
tant Comptroller General for Opera- 
tions, Greg Ahart will be Assistant 
Comptroller General for Human 
Resources, and John Heller and 


Harry Havens will continue as Assis- 
tant Comptrollers General for Policy 
and Program Evaluation, respective- 
ly. A future issue of the Review will 
cover these changes in detail. 





Philip A. Bernstein 


Mr. Philip A. Bernstein has been 
named as director, Human Re- 
sources Division, effective October 1, 
1982. 

Mr. Bernstein, a graduate of 
George Washington University (AB 
1958), joined GAO in 1960 and carried 
out diverse and increasing responsi- 
bilities in the former Civil Division. At 
the time of the reorganization in 
1972, he was in charge of GAO’s 
work at the former Atomic Energy 
Commission and served briefly in 
that capacity in the newly formed Re- 
sources and Economic Development 
Division. In 1972, he was named re- 
gional manager in Seattle. In 1976, 
he returned to headquarters as depu- 
ty director of Management Services 
and in 1978 moved to the Human Re- 
sources Division as deputy director. 
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Jim Hall 


Mr. Jim Hall, manager of GAO’s 
Los Angeles regional office, is retir- 
ing from the agency on September 17, 
1982. 

Mr. Hall joined GAO in 1952 in the 
San Francisco regional office. In 
1963, he transferred to the Civil Divi- 
sion as assistant director, becoming 
an associate director in 1967. Mr. 
Hall then left GAO for a position in 
the Office of the Secretary of the In- 
terior, returning to GAO in 1972 as 
associate director in the Federal Per- 
sonnel and Compensation Division. 
He became manager of the Los An- 
geles regional office in 1973. 

Mr. Hall is a graduate of the Uni- 
versity of Southern California and is 
a CPA (California). He has received 
numerous awards, including the FOD 
Director’s Award. 

Following his retirement, Mr. Hall 
will join the Hughes Aircraft Corpora- 
tion in Los Angeles as manager of 
the Business Division. 


David P. Sorando 


David P. Sorando, regional man- 
ager, Boston regional office, retired 
from GAO on September 3, 1982. 

Mr. Sorando began his career with 
GAO in 1953 with the New York re- 
gional office. He served as the man- 
ager in three regions: Cincinnati, 
Washington, and Boston. He was 
also a deputy director in two head- 
quarters divisions, the Manpower 
and Welfare Division (now HRD) and 
the Federal Personnel and Compen- 
sation Division. 

Mr. Sorando graduated from Ford- 
ham University after two tours of 
military service. He attended the Har- 
vard Program for Management Devel- 
opment in 1962 and the Federal Ex- 
ecutive Institute 8-week program in 
1972. He received the GAO Meri- 
torious Service Award in 1975, the 
Comptroller General’s Award in 1976, 
and GAO’s EEO Award in 1980. He 
has also been cited by the Federal 
Government Accountant’s Associa- 
tion, the Cincinnati Federal Exec- 
utive Board, the Federal Executive In- 
stitute, and the U.S. Army Finance 
Center, Fort Benjamin Harrison, In- 
dianapolis, among others. 





GAO Staff Changes 


Carl E. Wisler 


Mr. Carl E. Wisler has been se- 
lected for the position of associate 
director in the Institute for Program 
Evaluation with responsibility for 
evaluation methodology develop- 
ment assigned to GAO under title VII 
of the Congressional Budget Act, 
and for measurement assistance to 
other GAO divisions. 

Mr. Wisler began his career with 
the Federal Government in 1957 as a 
physicist/operations research Ana- 
lyst with the Naval Missile Center in 
California. He came to Washington 
in 1967 and was employed as an op- 
erations research analyst with the 
Office of Education. In 1970, Mr. 
Wisler was promoted to Education 
Evaluation Officer with the Depart- 
ment of Education. Since joining 
GAO in 1980, he has served as a 
supervisory operations research ana- 
lyst in IPE. 

Mr. Wisler received an M.S. from 
Kansas State University. He is a 
member of the American Association 
for the Advancement of Science, 
American Educational Research So- 
ciety, Evaluation Research Society, 
Kappa Mu Epsilon (National Hon- 
orary Mathematics Fraternity), and 
Lambda Delta Lambda (National 
Honorary Physical Science Fraterni- 
ty). 


Richard J. Woods 


After more than 33 years of Fed- 
eral service, Richard J. Woods, asso- 
ciate director, Community and Eco- 
nomic Development Division, retired 
on July 10, 1982. 

Mr. Woods joined GAO in August 
1951 from the Corporation Audit Co., 
Washington, D.C. His experience 
with GAO included audits of the Fed- 
eral Prison Industries, Inc.; Ten- 
nessee Valley Authority; National 
Bureau of Standards; Department of 
the Interior; Bureau of Public Roads; 
Department of State, International 
Operations Division; Department of 
Labor, Federal Executive Institute, 
Department of Agriculture; Office of 
the Director; and Department of 
Housing and Urban Development. 

Mr. Wood received the Comptroller 
General’s Award (Group) in 1976, the 
Director’s Award in 1976, Distin- 
guished Service Award in 1974, anda 
Certificate of Merit in 1978. 
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Additional Staff Changes 


NEW SUPERVISORY GAO EVALUATOR 


Field Operations Division-Denver 
James K. Meissner 
Mission Analysis and Systems Acquisition Division 
Patrick S. Donahue 
Charles F. Rey 
Homer H. Thomson 
Program Analysis Division 
Franklin Frazier 
Natwar M. Gandhi 


NEW SUPERVISORY OPERATIONS RESEARCH 
ANALYST 


Accounting and Financial Management Division 
Samuel E. Oliver 

Institute for Program Evaluation 
David A. Rogers 


NEW SUPERVISORY ECONOMIST 


Program Analysis Division 
Geraldine A. Gerardi 


NEW SUPERVISORY REGULATORY POLICY 
ANALYST 


Program Analysis Division 
JayEtta Hecker 


NEW COMPUTER SPECIALIST 


Mission Analysis and Systems Acquisition Division 
Harold J. Podell 


NEW ELECTRONICS ENGINEER 


Mission Analysis and Systems Acquisition Division 
George A. Sousa 
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GAO Staff Changes 


RETIREMENTS 


Charles D. Allegrina 
Mary J. Cook 
Earl L. Darrah 


Helen L. Durham 
Patricia M. Gill 


Andrew B. (Ben) McConnell 
Jesse R. Nicholson, Jr. 
Sattanie Onanian 
Katherine E. Orf 

Hattie R. Puryear 


John J. Reese 
Eleanor M. Seward 


Masaharu Yoshioka 
Louis E. Zott 


Attritions 


GAO Evaluator 

Lead Clerk-Stenographer 

Supervisory GAO 
Evaluator 

Secretary 

Secretary 


Special Assistant to the 
Director 
GAO Evaluator 


Secretary 
Secretary 
Adjudicator 


GAO Evaluator 
Editorial Assistant 


GAO Evaluator 
GAO Evaluator 


FOD-Detroit 

FOD-Detroit 

Energy and Minerals 
Division 

International Division 

Office of the Comptroller 
General 

Program Analysis Division 


Procurement, Logistics 
and Readiness Division 

Human Resources Division 

FOD-Washington 

Accounting and Financial 
Management Division 

FOD-Dallas 

Office of the General 
Counsel 

FOD-San Francisco 

FOD-Denver 


The following staff members left the agency during the period March 8-June 4, 1982. 


Division / Office 
Accounting and Financial 
Management Division 


Community and Economic 
Development Division 


Energy and Minerals Division 


Human Resources Division 


Mission Analysis and Systems 
Acquisition Division 


Program Analysis Division 


Name 

Susan Baker 
Mike Baskin 
William Farrell 
William Greyard 
George Hart 
Charles Tyler 


Glen B. Wolff 


Patricia Foley 
Susan Matiatios 
Phoebe Rolen 
George M. Saverno 
Beth Ward 


Patricia A. Hoffman 
Edmond J. Mihalski 
Phillip E. Neel 

Paul H. Kaeppel 


Jeffrey A. Benjamin 
Gayle L. DeLong 


To 

Private industry 

Law school 

Private industry 

Air Force 

Private industry 
Department of Defense 


Department of Housing and 
Urban Development 


CRU Consultants 

Arthur Young & Co. 
Department of the Army 
HRB-Singer, Inc. 

Home 


Central Intelligence Agency 
Senate Finance Committee 
Private industry 

U.S. Navy 


Central Intelligence Agency 
Graduate school 
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Attritions - continued 


Atlanta 


Boston 
Denver 
Kansas City 


Los Angeles 


New York 
Norfolk 


Philadelphia 


San Francisco 


Seattle 


Washington 


Ramona Grizzard 
Nancy D. Lynch 


Michele Silva 

Betty Hawley 

Mary K. Miller 
Loren Dear 

Jerry W. Dorris 
Dennis G. Schilher 
Michael Carlson 
Ollie Jackson 
Carmen Y. Thomas 
Roseanna Callaghan 
Carol McConway 
Michael B. McCormick 


Han Hansen 


James L. McMullin 
Eulanda D. Wyckoff 


Arthur S. Moldenhauer 
Beverly A. Richardson 


GAO Staff Changes 


Private industry 
Internal Revenue Service 


Not specified 
Department of Energy 
Maternity 

Air Force Audit Agency 
Air Force Audit Agency 
Air Force Audit Agency 
Not specified 
Department of Defense 
Norfolk Naval Shipyard 
Private industry 

Private industry 
Department of Commerce 


Office of Inspector General 


Not specified 
Air Force 


Department of Defense 
Maternity 


Editor’s Note: “Attritions” is an experimental addition to “GAO Staff Changes.” Please write a note to Diane Grant, 
Room 7124, if you would like to see this column continued or have suggestions for it. 
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NEW STAFF MEMBERS 





The following new staff members reported for work during the period March 8, 1982, through June 30, 1982. 


Accounting and 
Financial 
Management 
Division 


General Services 
and Controller 


Office of Information 
Systems and 
Services 


Office of Security 
and Safety 


Program Analysis 

Division 
REGIONAL OFFICES 
Los Angeles 


New York 


Mekee, Richard N. 


Paulson, Louis 


Canick, Maureen L. 


Green, Roger W. 
Gerardi, Geraldine A. 
Tuck, Charles C. 


Jimenez, Fred 


Parker, Florence 


Office of Personnel 
Management 


Deloitte, Haskins and 
Sells 


U.S. Bureau of the 
Census 


Federal Protective 
Service 


Department of Energy 
Department of Energy 


Social Security 


Small Business 
Administration 
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Professional Activities 


Office of the 
Comptroller General 


The Comptroller General, Charles 
A. Bowsher, addressed the following 
groups: 


Institute of Internal Auditors, 41st 
International Conference, Wash- 
ington, July 12. 


President’s Council on Integrity 
and Efficiency, Washington, 
Aug. 3. 


John D. Heller, Assistant Comp- 
troller General for Policy and Pro- 
gram Planning, addressed the follow- 
ing groups: 


OPM Executive Seminar on Public 
Program Management, on “The 
Role of GAO in Program Results 
Studies,” Kings Point, NY, Apr. 8 
and June 4. 


Syracuse University, Maxwell 
Graduate School of Citizenship 
and Public Affairs, on “The Evolv- 
ing Role of the General Account- 
ing Office Under the New Comp- 
troller General,’ Washington, 
May 26. 


Harry S. Havens, Assistant Comp- 
troller General, participated at the 
Association of Government Account- 
ants’ National Professional De- 
velopment Conference. His work- 
shop topic was “Government Bud- 
getary Reforms: An Agenda for the 
Eighties.” The Conference was held 
in Denver, June 14-16. 


Office of the General 
Counsel 


Seymour Efros, associate general 
counsel, spoke on “Current Devel- 
opments and Trends in Government 
Acquisition” before the 12th Annual 
Symposium on Government Acqui- 
sition, sponsored by the North Ala- 
bama Chapter of the Federal Bar As- 
sociation, in Huntsville, AL, Apr. 13. 


Richard R. Pierson, associate 
general counsel, spoke on ‘“‘Congres- 
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sional Oversight and the General 
Accounting Office” before a Sym- 
posium on Accountability and Over- 
sight for the Department of Educa- 
tion sponsored by the Government 
Affairs Institute, Office of Executive 
and Management Development, 
Office of Personnel Management, 
June 4. 


Ronald Berger, assistant general 
counsel: 


Addressed a seminar on Govern- 
ment ADP Acquisition in Alexan- 
dria, VA, Apr. 21. 


Spoke on “GAO Audits” before a 
program of the American Bar As- 
sociation National Institute enti- 
tled ‘The Hazards of Contracting 
with the Government,” May 14. 


Ronald Wartow, deputy assistant 
general counsel: 


Addressed the Forest Service Na- 
tional Contracting Officer’s Work- 
shop on bid protests, in Salt Lake 
City, UT, Mar. 22. 


Spoke before the National In- 
stitutes of Health Research Con- 
tracting Committee Symposium 
on research and development con- 
tracting, in Gaitherburg, MD, 
May 7. 


Personnel 


Felix R. Brandon, Il, director of Per- 
sonnel, attended the Directors of 
Personnel Conference on Perfor- 
mance Appraisal—Reducing the 
Workload, sponsored by the Inter- 
agency Advisory Group (IAG), in 
Crystal City, VA, Apr. 7. 


Accounting and 
Financial Management 
Division 

Wilbur D. Campbell, acting direc- 
tor: 


Gave a luncheon speech on 
“GAO’s Perspective of Financial 
Accountability” to the Baltimore 


Chapter, Association of Govern- 
ment Accountants, Essex Com- 
munity College, Baltimore, May 4. 


Served as Chairman and gave 
opening remarks at the National 
Intergovernmental Audit Form 
Joint Conference, May 10-12, in 
Nashville. He also served as 
moderator on sessions including 
form effectiveness, single audit, 
planning, reporting, and quality 
review. 


Selected as president-elect for the 
coming year for the Northern Vir- 
ginia Chapter, Association of Gov- 
ernment Accountants. 


Walter L. Anderson, senior 
associate director, spoke on “The 
Impact of Microcomputers on the Au- 
diting Profession” before the AGA 
Capital Region Chapter’s seminar on 
“The Automated Office of the Future: 
Office and Audit Applications,” in 
Washington, May 10. 


Brian Usilaner, associate director: 


Spoke on “Managing for Produc- 
tivity” at the Women in Govern- 
ment Annual Conference, Wash- 
ington, Mar. 19. 


Gave the keynote address on “Do- 
ing More With Less” for the 
Philadelphia Chapters of the 
American Society for Public Ad- 
ministration and the International 
Personnel Management Associa- 
tion Annual Conference, Mar. 31. 


Gave the keynote address on “Im- 
portance of Productivity in De- 
fense” at an Air Force Productivity 
Conference, Washington, May 18. 


George L. Egan, Jr., associate 
director: 


Participated as a moderator in a 
panel discussion for “The Single 
Audit Concept, Where Is It 
Going?,” and “The Office of In- 
spector General, Where Is It Go- 
ing?,” for an AICPA Educational 
Conference—“The Changing En- 
vironment in Audit,” Los Angeles, 
Mar. 9-10. 
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Professional Activities 


Participated as a panelist in the 
first conference of the National 
Association of State Comptrollers, 
Arlington, VA, Mar. 31. 


Spoke on “Fraud and Waste in 
Government,” before the Federal 
Executive Board, Houston, Apr. 20. 


Participated as a panel member of 
the Mid-America Intergovernmen- 
tal Audit Forum, Kansas City, 
Apr. 28-29. 


Spoke on “The Single Audit—The 
Audit Guide and Compliance Re- 
quirements,” before the Associa- 
tion of Government Accountants, 
Nashville, May 13. 


Spoke at the Municipal Finance 
Officers Association’s 1982 An- 
nual Conference on “The Eco- 
nomics of Government Audit- 
ing—Are We Paying Too Much or 
Too Little?,” New Orleans, May 24-26. 


Ronald J. Points, associate direc- 
tor: 


Spoke on “Internal Control—The 
Responsibility of Management,” 
at the American Society for Public 
Administration National Con- 
ference, Honolulu, Mar. 23. 


Spoke on GAO Audit Standards at 
the Municipal Finance Officers As- 
sociation Colloquia in Albany, NY, 
and Austin, TX, Apr. 16 and 19. 


Spoke on the GAO Audit Stan- 
dards and The Governmental Ac- 
counting Standards Board at the 
5th Annual Conference of Virginia 
CPAs in Williamsburg, VA, Apr. 22. 


Spoke on the “Governmental Ac- 
counting Standards Board— 
Myths and Facts,” at the American 
Accounting Association Mid-At- 
lantic Regional Conference at The 
Meadowland, NJ, Apr. 24. 


Spoke on the Governmental Ac- 
counting Standards Board and 
“The Future for Government Ac- 
countants in View of Reagan- 
omics and the New Federalism” at 
the Association of Government 
Accountants Conference in Nash- 
ville, May 13-14. 


Received the Northern Virginia 
Chapter, Association of Govern- 
ment Accountants’ Distinguished 
Leadership Award, Springfield, VA, 
May 18. 


Carl R. Palmer, group director, 
spoke on “GAO’s Reports on Com- 
puter and Communications Acquisi- 
tions” at the National Academy of 
Science Panel on Federal Computer 
Acquisition, in Washington, May 11. 


W.A. Broadus, group director: 


Spoke on “Government Auditing” 
at the monthly Northern Virginia 
Society of CPAs, Mar. 9. 


Spoke on ‘1981 Revised Audit 
Standards” at the HUD Staff De- 
velopment Conference, in Colum- 
bia, MD, Mar. 15. 


Spoke on ‘1981 Revised Audit 
Standards” at the Municipal Fi- 
nance Officers Association Collo- 
quia in Seattle, WA, on Mar. 22 and 
in Los Angeles on Mar. 24. 


Presented a workshop on ‘1981 
Revised Audit Standards” at the 
Staff Development Conference of 
the Defense Audit Service, in Lees- 
burg, VA, Mar. 29. 


Spoke on the “1981 Revised Audit 
Standards” at the Annual Con- 
ference of State Comptrollers, in 
Crystal City, VA, Mar. 30. 


Presented workshops on the ‘‘1981 
Revised Audit Standards” to U.S. 
audit personnel assigned to West 
Germany, in selected locations 
throughout West Germany, week 
of Apr. 5-9. 


Presented workshops on the ‘1981 
Revised Audit Standards” to sev- 
eral Association of Government 
Accountants chapters. 


Presented a workshop on “‘Govern- 
ment Auditing” at the Annual Mis- 
souri Society of CPAs’ conference 
in Jefferson City, Apr. 22. 


Joseph J. Donlon, senior group 
director, received a distinguished 
speakers award from the Department 
of Agriculture Graduate School for 
several speeches made at the Grad- 


uate School’s Senior Financial Man- 
aosinent Seminars, in Washington, 
May 12. 


Robert A. Pewanick, group direc- 
tor, assumed the Office of President 
of the Washington Chapter of the As- 
sociation of Government Accoun- 
tants, in June. 


Larry Sullivan, group director, dis- 
cussed “GAO’s Efforts to Prevent 
Fraud in Government Programs,” be- 
fore the Pacific Northwest Inter- 
governmental Audit Forum, Seattle, 
Apr. 22. 


Anthony Csicseri, group director, 
participated in a panel discussion on 
“The Airspace System Plan—Con- 
gressional Interest in Air Traffic Con- 
trol Computer Modernization and 
FAA’s Response to Congressional 
Recommendations,” in Washington, 
Mar. 9. 


Steve Sadler, group director, and 
Dennis Stowe, systems accountant, 
were selected as Directors of Finan- 
cial Management Assistance and of 
Professional Activities, respectively, 
for the Northern Virginia Chapter of 
the Association of Government Ac- 
countants, for 1982-1983. 


Ernst F. Stockel, senior accoun- 
tant, spoke on “EDP Auditors’ Roles 
in the Organizations They Serve” be- 
fore a meeting of the National Capi- 
tal Area Chapter of the EDP Auditor’s 
Association, Washington, May 25. 


Raymond C. Kudobeck, systems 
accountant, was appointed Meetings 
Chairperson of the Washington 
Chapter of the Association of Gov- 
ernment Accountants, in June. 


David B. Shumate, systems ac- 
countant, was reappointed Chairman 
of the Publicity Committee of the 
Washington Chapter, Association of 
Government Accountants, in June. 


Peter Lemonias, evaluator, spoke 
on “Managing For Productivity” at 
the Internal Revenue Service’s Pro- 
ductivity Coordinator Training Con- 
ference, Crystal City, VA, May 20. 


Jerry F. Wilburn, credit and collec- 


tion system analyst, gave a presenta- 
tion on current legislative and ad- 
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ministrative initiatives regarding 
Federal debt collection activities, be- 
fore the Public Affairs Public Rela- 
tions Committee of Associated Cre- 
dit Bureau, Inc., in Houston, May 5. 


Gloria V. Gatewood, secretary to 
the associate director, Financial Sys- 
tem Group, accompanied personnel 
specialists from GAO and spoke toa 
group of students at the Charles 
County Community College, La 
Plata, MD, for secretarial recruit- 
ment, Mar. 17. 


Edward Wingfield and Russell D. 
Schmidt, computer auditors, spoke 
on “EDP Auditing in GAO” before 
Representatives of the Comptroller 
General of Mexico, in Washington, 
Apr. 1. 


J. Chris Farley, management ana- 
lyst, spoke on legislation affecting 
debt collection before a debt collec- 
tion workshop, and with Mike 
Baskin, credit analyst, participated 
in a concurrent workshop on waiver 
processing at a Joint Military Serv- 
ice’s Information Exchange Program, 
Kansas City, Apr. 13-14. 


Paul Benoit, computer specialist, 
discussed ““GAO’s Systems Approval 
Process: Criteria, Methodologies, 
and Experiences,” before students in 
a graduate-level course on “Infor- 
mation Systems in Management” at 
Bowie State College, Maryland, 
Apr. 26. 


Joint Financial 
Management 
Improvement 
Program 


Susumu Uyeda, executive director: 


Spoke on central agencies’ in- 
itiatives at the DOD Information 
Exchange Commander’s Confer- 
ence, Indianapolis, May 5-6. 


Spoke on cash management at the 
Joint Conference of the National 
and Regional Audit Forums, in 
Nashville, May 10-12. 


Is national president-elect of the 


Association of Government Ac- 
countants. 
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Doris Chew, assistant executive 
director, was selected as director of 
education for the Washington Chap- 
ter of the Association of Government 
Accountants. 


Ken Winne, senior project director: 


Gave a presentation on the Grant 
Cash Management Study to the 
National Association of State 
Comptrollers Conference in 
Washington, Mar. 30. 


Is president-elect for the coming 
year for the Washington Chapter 
of the Association of Government 
Accountants. 


Community and 
Economic 
Development Division 


Joe Maranto, evaluator, discussed 
GAO’s report on illegal and unau- 
thorized activities on public lands, in 
a radio interview broadcast over CBS 
News affiliate KYXI (Portland, OR), 
Mar. 16. 


Dave Jones, issue area planning 
director, and Stan Ritchick, eval- 
uator, discussed GAO’s report, 
“States’ Compliance Lacking in 
Meeting Safe Drinking Water Regula- 
tions,” before the Association of Me- 
tropolitan Water Agencies, in Wash- 
ington, Mar. 18. 


John Hunt, evaluator, participated 
in a workshop on “How Abandoned 
Hazardous Waste Sites Can Best Be 
Ranked in Order to Most Effectively 
Allocate Superfunded Monies for Re- 
medial Action,” in Washington, 
Mar. 19-20. 


Henry Eschwege, director, spoke 
on “The Functions of the General Ac- 
counting Office,” before the Brook- 
ings Institution’s Conference for 
Business Executives on Government 
Operations, in Washington, Apr. 5. 


Frank Subalusky, group director, 
led a discussion on developing a 
Federal plan for a quality improve- 
ment program for the U.S. fishing in- 
dustry, before the National Marine 
Fisheries Task Force, in Washington, 
Apr. 14-15. Mark Clark, evaluator, par- 
ticipated in the discussion. 
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Jerry Killian, group director, spoke 
on GAO’s role in reviewing Federal 
nutrition programs and issues, be- 
fore the Nutrition Policy Seminar of 
the National Nutrition Consortium, 
Washington, Apr. 27. 


Cathy Slesinger, evaluator, was 
recently interviewed by Jim Wyn- 
brandt of New York’s Progressive Ra- 
dio Network on CED’s report, “Small 
Car Safety: An Issue That Needs 
Further Evaluation” (CED-82-29, 
Apr. 26, 1982). 


Ralph Lamoreaux, evaluator, dis- 
cussed “The Role of the General Ac- 
counting Office and Its Relation to 
Agricultural Research,” before the 
Cooperative State Research Service 
workshop for new research admin- 
istrators, in Washington, May 12. 


Walter Hess, evaluator, discussed 
“The Mission of and the Federal Role 
in the Cooperative Extension Serv- 
ice,” before the National Agricultural 
Research and Extension Users Ad- 
visory Board, Beltsville, MD, May 18. 


General Government 
Division 


John Butcher, senior evaluator, 
was elected Treasurer of the Wash- 
ington Chapter of the National As- 
sociation of Accountants for 1982-83. 


William J. Anderson, director: 


Addressed The Brookings Institu- 
tion Conference for Business Ex- 
ecutives on Federal Government 
Operations, Washington, Mar. 23. 


Was key speaker and panelist at 
Spring Pacific Northwest Intergov- 
ernmental Audit Forum meeting in 
Seattle, WA, on Discussion on 
Block Grants and on Quality Con- 
trol Over Audits, Apr. 23. 


Addressed the 1982 Annual Meet- 
ing of the National Association of 
Tax Administrators on GAO’s 
study of the State Taxation of 
Multijurisdictional Business, New 
Orleans, June 1. 


Sebastian Correira, Jr., group di- 


rector, as part of a panel discussion 
on Block Grant Implementation, 
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briefed the Eastern Regional Con- 
ference of the Council of State Gov- 
ernments on the results of GAO’s 


Block Grant Transition Review, in: 


Boston, May 7. 


Human Resources 
Division 


Maurice Moody, senior evaluator, 
and Gary Ziebarth, Seattle, evaluator, 
spoke on GAO’s report, “Labor 
Should Make Sure CETA Programs 
Have Effective Employability 
Development Systems” (HRD-82-2, 
Jan. 13, 1982) before the Workshop 
on Employability Development Plan- 
ning, sponsored by the Tennessee 
Employment and Training Institute, 
Nashville, Apr. 22. 


Ed Mihalski, evaluator, spoke on 
“Federal Policies Impacting on End 
Stage Renal Disease Care,” at the 
13th Annual National Symposium of 
the American Association of Neph- 
rology Nurses and Technicians, 
Chicago, Apr. 15. 


Patricia Moore, senior evaluator, 
was interviewed by WXRT Radio, Chi- 
cago, about the report, “Implementa- 
tion of the Phaseout of CETA Public 
Service Jobs” (HRD-82-48, Apr. 14, 
1982). 


Charles Trahan, evaluator, spoke 
on “Stress and Coping,” at the Uni- 
versity of the District of Columbia’s 
Third Annual Peer Counseling Con- 
ference, Washington, May 13. 


Mort Henig, associate director, 
discussed GAO’s review of the clo- 
sure of the Community Services Ad- 
ministration, at a workshop on “‘Les- 
sons Learned in Closing Down or 
Scaling Down Government Opera- 
tions,” at JFMIP’s Financial Man- 
agement Conference, Washington, 
Mar. 22. 


Jim Walsh, group director, wrote a 
chapter, “Cost of Home Services 
Compared to Institutionalization,” in 
Community Housing Choices for 


Older Americans, edited by M. 
Powell Lawton and Sally L. Hoover. 
His chapter is based on GAO’s ex- 
tensive reviews of the well-being of 
older people in Cleveland, Ohio. 
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Institute for Program 
Evaluation 


Eleanor Chelimsky, director: 


Delivered the keynote address, 
“The Contributions of Evaluation 
to Constructive Governmental 
Change” at OPM’s 2-week residen- 
tial seminar on program evalua- 
tion, May 18. 


Delivered the keynote address, 
“Evaluation’s Contribution to Con- 
structive Governmental Change” 
at the Eastern Evaluation Re- 
search Society’s annual con- 
ference in New York City, May 24. 


Venkareddy Chennareddy, econo- 
mist, presented a paper entitled “The 
Impact of Gasoline Price and Short- 
age on the Visits to National Park 
Recreation Facilities,’ which was 
coauthored by Heber Bouland, super- 
visory operations research analyst, 
at the annual meeting of the Eastern 
Economic Association, Apr. 29- 
May 1. 


Wallace M. Cohen, senior group di- 
rector, designed and taught a course 
on evaluation to senior executives at 
the Federal Executive Institute, in 
Charlottesville, VA, the week of 
Apr. 5. 


Odille S. Hansen, program analyst, 
used her skills to help the Northern 
Virginia chapter of the American 
Heart Association evaluate public 
awareness of the signals and symp- 
toms of heart attacks. 


Arthur J. Kendall, statistician, 
chaired a session on classification 
at the joint meeting of the Psycho- 
metric Society and the Classification 
Society in Montreal, June 2. 


Bruce D. Layton, social science 
analyst, is coauthor of a chapter, 
“Ethical Conflict in Clinical Decision 
Making: A Challenge for Family Ther- 
apists,” published in Va/ues, Ethics, 
Legalities and the Family Therapist, 
edited by J.C. Hansen and L. L’Abate. 


Garry L. McDaniels, deputy direc- 
tor, discussed evaluation activity un- 
der circumstances of the current 
budget at a National Institute for 


Public Affairs seminar on Manage- 
ment Issues in the Public Services, 
May 11. 


Eric A. Peterson, social science 
analyst, took part in a panel discus- 
sion on “Welfare State Periods and 
Cycles,” at the Third International 
Conference of lEuropeanists, in 
Washington, May 1. | 


James H. Solomon, operations re- 
search analyst, spoke on “Home 
Health Care: What Is It?” before a 
conference sponsored by the United 
Hospital Fund of New York, in New 
York, Apr. 5. 


Ray C. Rist, deputy associate 
director: 


Presented a training workshop on 
qualitative evaluation methods at 
the American Educational Re- 
search Association national meet- 
ing in New York City, in March. 


Has published the article, “Walk- 
ing Through a House of Mirrors: 
Youth Employment and Education 
Training” in Urban Development, 
1982. 


Was the keynote speaker at a 
Western New York State meeting 
of education and business leaders 
working to develop effective 
school-to-work transition  stra- 
tegies, in New York, in April. 


Has published the article, ‘“Be- 
yond the Quantitative Cul-de-sac: 
A Qualitative Perspective on Youth 
Employment Programs” in Policy 
Studies Journal, 1982. 


Waverly E. Sykes, Jr., operations 
research analyst, discussed ‘In- 
sights and Inferences: A Reflect on 
‘Models, Data, and War’ ”’ before the 
Workshop on Modeling and Simula- 
tion of Land Combat, cosponsored 
by the Army Research Office and the 
Georgia Institute of Technology, in 
Pine Mountain, GA, Mar. 28-31. 


Harold C. Wallach, statistician: 


Organized and chaired a session 
on “Changing Families and Value 
Systems” at a meeting cospon- 
sored by the National Council of 
Associations for the Policy Sci- 
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ences and the D.C. Chapter of the 
World Future Society, Washing- 
ton, Feb. 26. 


Presented a paper on “Developing 
a Typology of Counties to Address 
Human Services Delivery and So- 
cio-Economic Impact Issues,” at 
the University of Wisconsin’s fifth 
annual conference on the smali 
city and regional community, 
Mar. 24-26. 


Mission Analysis and 
Systems Acquisition 
Division 


Donald E. Day, senior associate 
director: 


Spoke on “The Role of the GAO in 
Major Acquisitions” at the Navy 
Systems Acquisition Management 
School, Washington, Apr. 23, and 
at the Defense Systems Manage- 
ment College, Fort Belvoir, VA, 
May 10. 


Participated in an informal panel 
discussion on various procure- 
ment and systems acquisition is- 
sues at the National Security In- 
dustrial Association’s Spring Pro- 
curement Committee Program, 
Hot Springs, VA, June 7. 


C. William Moore, Jr., associate di- 
rector, discussed ‘‘The Role and Ev- 
olution of Defense Technology Man- 
agement” before the American De- 
fense Preparedness Association’s 
Science and Engineering Sym- 
posium, White Oak, MD, May 5. 


John G. Barmby, assistant to the 
director for systems analysis, 
chaired a panel on “The Impact of 
Human Factors for Cost Reduction 
of Weapon Systems” at a quarterly 
meeting of the Management Com- 
mittee of the American Institute of 
Aeronautics and Astronautics, 
Baltimore, May 26. 


Lester C. Farrington, Jr., group 
director, spoke on “GAO’s Role in 
Test and Evaluation,” at the Naval 
Training Development Center, Orlan- 
do, FL, Mar. 31, and at the Defense 
Systems Management College, Fort 
Belvoir, VA, Apr. 29, and Vandenberg 
AFB, CA, May 26. 
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Bernard D. Easton, group director, 
was interviewed by broadcasters 
from various U.S. and foreign radio 
stations following the release of 
GAO’s report, “DOD’s Space-Based 
Laser Program—Potential, Progress, 
and Problems” (C-MASAD-82-10, 
Feb. 26, 1982). 


David G. Sapp, senior evaluator, 
spoke before the Defense Systems 
Management College on “GAO’s 
Role in Test and Evaluation,” Fort 
Belvoir, VA, Apr. 29. 


Procurement, 
Logistics and 
Readiness Division 


Clark Adams, group director, 
discussed the past, present, and fu- 
ture of cost accounting standards, 
before the American Society of Mil- 
itary Comptroillers, in New Orleans, 
May 21. 


Ron King, senior evaluator, dis- 
cussed ‘Moving the Building Proc- 
ess into the 21st Century,” at the 
1982 International Conference on 
Computers/Graphics in the Building 
Process, in Washington, March 26. 


Ray Dunham, group director, par- 
ticipated in the ADPA Executive 
Seminar on Ammunition Programs, 
in Orlando, FL, Apr. 22. 


As a visiting lecturer in Sweden, 
Julia Denman, senior evaluator in 
PLRD, gave several lectures and 
discussed Life Cycle Costing and 
Logistics Management issues with 
representatives of Swedish private 
industry, government agencies, and 
the Society of Logistics Engineers 
during the week of May 3-10. 


Program Analysis 
Division 


Kenneth W. Hunter, senior 


associate director: 


Spoke on “The Future of Budget 
and Program Analysis” and mod- 
erated a plenary panel on “Im- 
plementing the Major Changes of 
the Reagan Administration” at the 
spring symposium of the Ameri- 
can Association for Budget and 
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Program Analysis, in Washington, 
May 7-8. 


Took part in the first annual meet- 
ing of the newly created Issues 
Management Association, as one 
of the 20 cofounders from private 
industry, research, and govern- 
ment, hosted by The Congres- 
sional Research Service, in Wash- 
ington, Mar. 25. 


Osmund T. Fundingsland, asso- 
ciate director, briefed the National 
Academy of Sciences’ Committee on 
Government-University Relation- 
ships in Support of Science on PAD’s 
related ongoing assignments, in 
Washington, Apr. 12. 


Mary R. Hamilton, group director 
gave a presentation on “Government 
Approaches to Innovation” at the 
1982 national conference on _ In- 
dustrial Science and Technological 
Innovations, sponsored by the Na- 
tional Science Foundation in Stur- 
bridge, MA, May 5. 


James Bothwell, economist, coau- 
thored an article, “Efficiency in the 
Provision of Health Care: An Ana- 
lysis of Health Maintenance Organi- 
zations,” published in the April 1982 
edition of Southern Economic Jour- 
nal. 


Gwendolyn B. Moore, social sci- 
ence policy analyst, spoke on the 
policy analysis process as it relates 
to our small business innovation 
report (PAD-81-15, July 7, 1981), at 
Pennsylvania State University, 
May 13. 


Howard Gobstein, science policy 
analyst, participated in a panel dis- 
cussion on research instrumentation 
before the National Academy of Sci- 
ences’ Committee on Government- 
University Relationships in Support 
of Science, in Washington, Apr. 13. 


Field Operations 
Division 
Atlanta 


Marvin Colbs, regional manager, 
spoke on “Carrying Out Oversight 
Functions—How GAO interfaces 
with DOD,” to the Professional Mil- 
itary Comptroller School, Maxwell 
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AFB, AL, May 6. 


Pat Darnell, assistant regional 
manager, spoke on “Thinning the 
Waste of Big Government,” to the At- 
lanta Central Chapter of the National 
Association of Accountants, Atlanta, 
Apr. 19. 


Gene Barnes, evaluator, spoke on 
GAO functions and responsibilities 
and future career opportunities with 
GAO, to the Accounting Club at Mer- 
cer University, Atlanta, May 4. 


Cincinnati 


Owen Barnhart, evaluator, is the 
new AGA Cincinnati Chapter Presi- 
dent. 


Joe Quicksall, supervisory evalu- 
ator, spoke on “The Telephone—An 
Effective Weapon in the Fight 
Against Fraud, Waste, and Abuse,” 
at a luncheon meeting of the Federal 
Executive Board, Dallas, Mar. 16. 


Denver 


Robert W. Hanlon, regional man- 
ager, discussed the roles and re- 
sponsibilities of a regional office 
with Denmark’s Auditor General Jor- 
gen Bredsdorff, at the Denver re- 
gional office, May 13. 


James K. Meissner, 
spoke on: 


evaluator, 


“GAO’s Role in Program Manage- 
ment” at the Office of Personnel 
Management’s Public Program 
Management seminar, at the 
Western Executive Seminar Cen- 
ter, Denver, Mar. 22 


“Federal Water Availability for En- 
ergy Development” at the Amer- 
ican Society of Civil Engineers’ 
Conference on Water and Energy: 
Technical and Policy Issues, Ft. 
Collins, CO, June 29. 


Bill J. North, evaluator, has been 
appointed to the Career Education 
Committee of the Colorado Society 
of Certified Public Accountants for 
the 1982-83 year. 


Ralph K. Spencer, Ill, evaluator, re- 
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ceived an Outstanding Service 
Award from the Association of Gov- 
ernment Accountants’ Denver Chap- 
ter for his sustained, excellent con- 
tributions to the chapter over the last 
4 years. 


Kansas City 


David A. Hanna, regional manager, 
and Susanne Valdez, evaluator, at- 
tended the Mid-America Intergovern- 
mental Audit Forum meeting in Kan- 
sas City, Apr. 29. The meeting topic 
was ‘‘Contracting for Audit 
Services.” Mr. Hanna is the Chair- 
man and Ms. Valdez is the Executive 
Director of the Mid-America Forum. 
They also met on Apr. 28 with rep- 
resentatives of the lowa, Nebraska, 
Missouri, and Kansas CPA Societies. 


Gary Billen, evaluator: 


Spoke on “The Importance of Be- 
ing Able to Access Computerized 
Records in Auditing Federal Pro- 
grams and Financial Records,” 
before a systems accounting 
class at the University of Missouri, 
Kansas City, 1982. 


Participated in Oklahoma Universi- 
ty’s 1982 Career Fair, Apr. 21-22. 
The focus of the Career Fair was 
to help the students understand 
the difference between the “Aca- 
demic World” and the “World of 
Work.” He visited an accounting 
class and facilitated a discussion 
on the various types of account- 
ing, auditing, and evaluating pro- 
fessions available in the Govern- 
ment. After the class visit, he set 
up a booth at the Career Fair and 
explained the opportunities in 
GAO ranging from the cooperative 
education program to the career 
service. 


Los Angeles 


Ron Bononi, senior evaluator, 
spoke on “GAO Perspective of Se- 
lected DOD Acquisition Initiatives” 
before the Beach Cities Chapter, Na- 
tional Contract Management Associ- 
ation, May 11. 


Fred Gallegos, evaluator: 


Taught a graduate course on 
“Management Information Sys- 


tems” during the spring quarter at 
California State Polytechnic Uni- 
versity, Pomona. 


Taught three 1-day courses on 
EDP auditing for the Western Inter- 
governmental Forum, Apr. 13-15. 


Norfolk 


Nixon Williams, senior evaluator, 
participated in an on-the-air interview 
over WEEI radio, concerning GAO re- 
port HRD-82-36, “Physician Cost 
Containment Training Can Reduce 
Medical Cost,” Boston, Apr. 26. 


Donald Ingram, senior evaluator, 
spoke on “Computer Auditing” as 
part of a training seminar sponsored 
by the local chapter of the American 
Society of Women Accountants, Nor- 
folk, Apr. 24. 


Philadelphia 


Cliff Martin, evaluator, and Hilary 
Stephenson, evaluator, served on the 
Conference Committee for “Less is 
More: Doing More With Less.” The 
1-day conference was cosponsored 
by the Philadelphia chapters of the 
American Society for Public Ad- 
ministration and the International 
Personnel Management Association. 
The conference was attended by over 
100 professionals from Federal, 
State, and local governments, 
Mar. 31. 


Ralph Carlone, regional manager, 
spoke before the Philadelphia Chap- 
ter of the National Association of Ac- 
countants, on GAO’s past, present, 
and future, Apr. 22. 


San Francisco 
Charlie Vincent, senior evaluator: 


Presented a seminar for the San 
Jose Chapter of the Institute of In- 
ternal Auditing on “Innovations in 
Operational Auditing,’ San Jose, 
Apr. 7. 


Presented a seminar for the GSA 
Regional Inspector General staff 
on “Operational Auditing,” San 
Francisco, Apr. 30. 


Received an AGA chapter service 
award for eductional contributions 
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to the Peninsula-Palo Alto Chapter 
of AGA, in May. 


Jack Birkholz, senior evaluator: 


Spoke to the San Francisco Chap- 
ter of the EDP Auditors Asso- 
ciation on ‘Developing and Doc- 
umenting EDP Audit Findings,” 
Apr. 20. 


Taught a course on “Developing 
Report Findings for California 
State Auditors,’ Sacramento, 
Apr. 19. 


Jeff Ejichner, senior evaluator, 


spoke to the Sonoma State Universi- 


ty Accounting Forum on “Efficiency, 
Economy, and Effectiveness,” Rohn- 
ert Park, Mar. 30. 


George Hartmann, senior eval- 
uator, Steve Reed, senior evaluator, 
Jack Birkholz, senior evaluator, and 
Genevieve Niedzwieki, secretary to 
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the regional manager, received certif- 
icates of appreciation in April from 
the Peninsula-Palo Alto Chapter of 
AGA for their contributions to the 
chapter. 


Seattle 


William Taylor, evaluator, dis- 
cussed his experiences in Seattle 
Pacific University’s Weekend Univer- 
sity Program on the King-TV (NBC af- 
filiate) program, “Living the Good 
Life,” Seattle, Feb. 28. 


Gary D. McGill, assistant regional 
manager, and Randall B. Williamson, 
senior evaluator, spoke on “GAO’s 
Roles, Responsibilities, Functions, 
and Operations,” at a meeting of the 
Bellevue, WA, Chamber of Com- 
merce, Mar. 23. 


Sterling J. Leibenguth, senior eval- 
uator, and Janet E. Corrigan, eval- 
uator, discussed career oppor- 
tunities in the Federal Government 
and GAO at a meeting of the Beta 
Alpha Psi accounting fraternity, 
University of Washington, Seattle, 
Apr. 13. 


Stephen J. Jue, technical as- 
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sistance group manager, spoke on 
“Risk Assessment As It Applies To 
Computerized Data,” at the spring 
meeting of the Pacific Northwest 
Intergovernmental Audit Forum, 
Seattle, Apr. 22. 


Donald A. Praast, senior evaluator, 
received the Outstanding Service 
Award from the Pacific Northwest In- 
tergovernmental Audit Forum for his 
work and accomplishments as the 
forum’s executive secretary from 
1978 to 1982, Seattle, Apr. 22. 


Gary E. Ziebarth, senior evaluator, 
along with Maurice Moody, eval- 
uator, HRD, discussed GAO’s report, 
“Labor Should Make Sure CETA Pro- 
grams Have Effective Employability 
Development Systems” (HRD-82-2, 
Jan. 13, 1982), at a workshop for Ten- 
nessee State, local, and private non- 
profit CETA training personnel, spon- 
sored by the Center for Manpower 
Studies, Tennessee Employment and 
Training Institute, Memphis State 
University, Nashville, Apr. 22-23. 








Annual Awards for Articles 
Published in The GAO Review 


Cash awards are presented each year for the best articles written by GAO 
staff members and published originally in The GAO Review. The awards are 
presented during the GAO Awards Program held annually in October in 
Washington. 

One award of $500 is available to contributing staff 35 years of age or 
younger at the date of publication and another is available to staff over 35 
years of age at that date. Staff through grade GS-15 at the time they submit 
the article are eligible for these awards. 

The awards are based on recommendations of a panel of judges 
designated by the Editor. The judges will evaluate articles from the stand- 
point of their overall excellence, with particular concern for 
e originality of concept and ideas, 

e degree of interest to readers, 

e quality of written expression, 

e evidence of individual effort expended, and 
e relevance to ‘“GAO’s mission.” 





Statement of Editorial Policy 


This publication is prepared primarily for use by the staff of the General Ac- 
counting Office (GAO) and outside readers interested in GAO’s work. Except 
where otherwise indicated, the articles and other submissions generally ex- 
press the views of the authors and not an official position of the General Ac- 
counting Office. 

The GAO Review’s mission is threefold. First, it highlights GAO’s work 
from the perspectives of subject area and methodology. (The Review usually 
publishes articles on subjects generated from GAO audit work which are in- 
herently interesting or controversial. It also may select articles related to in- 
novative audit techniques.) Second and equally important, the Review pro- 
vides GAO staff with a creative outlet for professional enhancement. Third, it 
acts as historian for significant audit trends, GAO events, and staff activities. 

Potential authors and interested readers should refer to GAO Order 1551.1 
for details on Review policies, procedures, and formats. 
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